← Graph

Mutation Testing

concept 9 connections

A strong form of coverage dating back to the 1970s. A derived, automatable check: the tool takes code and tests, applies transformations to the code, and reports transformations the tests fail to detect as 'unspecified semantics'. The human then either removes that semantics or adds a test to specify it. Cannot be further automated past the decision step. Motivated by regression prevention: code may be correct today but not proven to stay correct; mutation testing nails required semantics so future changes (by coworkers, interns, or your future self) cannot silently regress them. Technique is language-agnostic; engines exist for Ruby (Mutant), Haskell (Heckle), JavaScript, Scala, C#, etc. Does not guarantee correctness — only that an automated tool could not find holes; serves as a first line of code review. Equivalent mutations (semantically-identical transformations a test cannot kill) occur but are rare in practice, especially when using semantic-reduction operators.

category
practice
about
Mutation Testing concept
Takeaway frames mutation testing as replacing mechanical reviewer questions.
about
Mutation Testing concept
Question is about scope of adoption.
about
Mutation Testing concept
Talk explains mutation testing as a derived-check technique dating to the 1970s.
tool Heckle
about
Mutation Testing concept
Heckle is a Haskell mutation-testing tool.
about
Mutation Testing concept
Question about cross-language mutation testing.
about
Mutation Testing concept
Frames Schirp's upcoming mutation-testing talk as how to remove redundant semantics automatically.
about
Mutation Testing concept
Mutation testing is the automated way the team removes redundant semantics per this axiom.
about
Mutation Testing concept
Named as a way to reduce wiggle room and raise the automation threshold.
person Markus Schirp
recommends
Mutation Testing concept
Argues every project should use mutation testing because human time is the most expensive resource.

Provenance

Read by
8 extractions