Add evidence-based regression and schema compatibility checks

2026-07-20 14:21:42 -03:00
parent d81286e322
commit 501e6cd589
13 changed files with 1496 additions and 17 deletions
@@ -87,6 +87,11 @@ Inspect also shows inferred contract proposals and runs deterministic contract
 conformance when both tool schemas are explicit. Prompt outputs are synthesized
 from their schemas; code, nested-tool, and MCP steps are reported as unsupported
 instead of being executed implicitly.
+Use `cmdforge inspect <tool> --save-baseline` to explicitly promote passing
+evidence to `conformance.json`. Later inspections and local publish dry-runs
+rerun the stored synthetic inputs and report state, coverage, contract, and
+normalized output changes. ToolStep preflight also compares the values the
+runner supplies with the called tool's input contract.

 ### Step Types