feat(conformance): add narrowed Step 1 runner#325
Merged
pentaxis93 merged 7 commits intoMay 29, 2026
Conversation
Add the authoring-time runner for C-2 workflow contracts, C-3 mechanics, C-4 artifact instances, and JSON Schema definitions. The runner adapts the existing validators into aggregate pass/fail results and exposes a CLI for default source-tree checks and explicit fixture paths. Refs #297
Route C-2 conformance through a populated workflow registry and convert explicit path read failures into aggregate failed results so review-fix runs keep reporting remaining units. Refs #297
Resolve explicit TOML unit paths before Step 1 classification so bare filenames passed from workflow-contracts/ or mechanics/ retain their directory-scoped C-2/C-3 category. TOML files outside those unit directories remain unsupported by design. Refs #297
Align workflow registry mechanic discovery with the recursive conformance unit discovery path so workflow contracts can reference mechanics under mechanics subdirectories. Refs #297
Treat non-UTF-8 conformance units as read failures so malformed explicit inputs produce failed results without aborting the run. Refs #297
Reuse the runner discovery rules for directory arguments so non-unit files such as manifest.toml are skipped during expansion, while explicitly named unsupported files still fail. Refs #297
Directory arguments can name either a methodology root or a unit directory. Expand direct unit directories with their category rules so requested checks are not skipped silently. Refs #297
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
python -m tooling.conformancefor narrowed Step 1 C-2/C-3/C-4 conformance checks.Changes
tooling.conformancewith source discovery, explicit path expansion, category classification, validator adapters, and CLI reporting.GitHub Issue(s)
Closes #297
Test plan
python -m unittest tests.test_conformance tests.test_workflow_contracts tests.test_mechanics tests.test_artifact_schemaspython -m tooling.conformancepython -m tooling.conformance tests/fixtures/workflow-contracts/valid-*.toml tests/fixtures/mechanics/valid-*.toml tests/fixtures/artifacts/valid-*.json