Why it matters
garak 0.14.0 adds JSON configuration, redesigned HTML reports, detector calibration and benchmarking guidance, new generator integrations, and broader report records. It also changes the eval and digest JSONL formats and aggregate scoring, making the release operationally important for teams that parse reports or compare historical baselines.
My takeaway: Pin the garak version in repeatable evaluations, update report parsers for the new schema, and run a fixed calibration corpus before and after upgrading. Record probe, detector, generator, configuration, and tool versions with every result; do not compare old and new aggregate scores without validating the scoring change.