Summary
specsmith req trace reports incorrect test IDs for REQ-NN-002, showing TEST-NN-020, TEST-NN-020 (duplicated) instead of the correct TEST-NN-002a, TEST-NN-002b.
Problem
The docs/tests/nn.yml file contains two test cases correctly mapped to REQ-NN-002:
- id: TEST-NN-002a
requirement_id: REQ-NN-002
- id: TEST-NN-002b
requirement_id: REQ-NN-002
However specsmith req trace outputs:
✓ REQ-NN-002 → TEST-NN-020, TEST-NN-020
TEST-NN-020 is the HuggingFace LogitsProcessor test — completely unrelated to REQ-NN-002 (Admissibility Oracle Correctness).
Expected behavior
✓ REQ-NN-002 → TEST-NN-002a, TEST-NN-002b
Impact
specsmith req orphans correctly reports "No orphaned test references" (so orphan detection is unaffected)
specsmith audit correctly reports "All 20 accepted REQ(s) have test coverage"
- Only the
req trace display output is wrong
- Misleading for audit trail and patent provenance documentation
Environment
- specsmith 0.11.5
- Python 3.12, Windows 11
- Test IDs with letter suffixes (e.g. TEST-NN-002a, TEST-NN-002b) — possible parsing issue with alphanumeric suffixes?
Summary
specsmith req tracereports incorrect test IDs for REQ-NN-002, showingTEST-NN-020, TEST-NN-020(duplicated) instead of the correctTEST-NN-002a, TEST-NN-002b.Problem
The
docs/tests/nn.ymlfile contains two test cases correctly mapped toREQ-NN-002:However
specsmith req traceoutputs:TEST-NN-020is the HuggingFace LogitsProcessor test — completely unrelated to REQ-NN-002 (Admissibility Oracle Correctness).Expected behavior
Impact
specsmith req orphanscorrectly reports "No orphaned test references" (so orphan detection is unaffected)specsmith auditcorrectly reports "All 20 accepted REQ(s) have test coverage"req tracedisplay output is wrongEnvironment