test-instrumenter

A Java Agent for instrumenting tests, mainly used for undeclared inputs checking (see test-inputs-check).

Debugging

If you want to see debug logs and stack traces from the JVM, add this line to your local.properties:

test.instrumenter.debug=true

System properties

The following system properties are recognized:

System property	Description	Source
test.instrumenter.debug	Enable/disable debug logging and JVM stack traces	local.properties
test.instrumenter.inputs.check.enabled	Enable/disable inputs checking instrumentation	test-inputs-check
test.instrumenter.root.dir	Root dir of kotlin.git	test-inputs-check
test.instrumenter.build.dir	Build dir of the project executing tests	test-inputs-check
test.instrumenter.declared.inputs.file	Path to file containg list of declared inputs	test-inputs-check

Benchmarking

The performance of the TestInputsChecker is measured by the JMH microbenchmark TestInputsCheckerBenchmark.

To run the benchmark:

./gradlew :test-instrumenter:jmh

After it completes, the benchmark-baseline.txt file will be updated.

The number of milliseconds in Score column should be interpreted as how much overhead the input checking instrumentation adds per 100k files accessed.

[!TIP] Run the benchmark before and after modifying TestInputsChecker to compare the performance