Skip to content

docs: VERIFICATION.md trust-receipt guide (closes #35)#136

Merged
rylinjames merged 1 commit into
mainfrom
docs/verification-trust-receipt
May 15, 2026
Merged

docs: VERIFICATION.md trust-receipt guide (closes #35)#136
rylinjames merged 1 commit into
mainfrom
docs/verification-trust-receipt

Conversation

@rylinjames
Copy link
Copy Markdown
Collaborator

Summary

Adds docs/verification.md — plain-English guide to the auto-generated VERIFICATION.md trust receipt. Closes #35.

Verified against src/reflex/verification_report.py — every section + field name in the doc maps to a real line of the renderer.

Adapted from #130

@DsThakurRawat opened #130 with the same goal. The teaching structure (When is it created → Section-by-section breakdown → Key metrics → Interpreting by vertical → What to do when it fails) is theirs and good; preserved via Co-Authored-By on the commit.

What's the same as #130

  • All fixture numbers kept (1.192e-07, 2.384e-07, 1.788e-07, etc.). Earlier I lumped these in with "fabricated content" — that was wrong. They're float32 ULP multiples characteristic of correctly-exported models, and the aggregate 2.384e-07 lines up with pi0.5's actual first-action max_abs (2.38e-07) from the README parity ledger. Most likely DsThakurRawat ran reflex validate on a real pi0.5 export.
  • Section structure, metric explanations, vertical interpretations table — kept whole.
  • mean_abs_diffmax_abs_diff framing — accurate teaching.

What's different

Change Why
Reflex version label: 0.2.10.9.6 0.2.1 doesn't appear in any recent CHANGELOG — at minimum a copy-paste stale; current is 0.9.6
Added note: "auto-filled from reflex.__version__" Tells readers the field is automatic, not something they edit
Added cross-reference to the actual parity-ledger numbers Readers can sanity-check their own runs against shipped values (SmolVLA 5.96e-07, pi0 2.09e-07, pi0.5 2.38e-07, GR00T 8.34e-07) — these match the README
Added Files-section preamble: Total: N files, X size The live renderer emits this; #130's example dropped it
File renamed: understanding_verification.mdverification.md Sibling docs use <topic>.md (eval.md, embodiment_schema.md, etc.); the understanding_ prefix was the only outlier
Removed cross-ref to TROUBLESHOOTING.md That file doesn't exist on main yet (still in #129); replaced with a reflex doctor flow that does exist
Added link to src/reflex/verification_report.py as source-of-truth If doc ever drifts from real output, the renderer wins — link makes that explicit

Closes / supersedes

Test plan

Adds docs/verification.md walking users through the auto-generated
VERIFICATION.md artifact — the trust receipt proving an exported ONNX
model matches its PyTorch source at machine precision.

Structure verified against src/reflex/verification_report.py — every
section + field name in the doc maps to a real line of the renderer.

Adapted from #130:
- Kept the fixture numbers (1.192e-07, 2.384e-07, etc.) — they're
  float32 ULP multiples, characteristic of correctly-exported models,
  and 2.384e-07 lines up with pi0.5's actual first-action max_abs
  (2.38e-07) from the README parity ledger.
- Refreshed Reflex version (0.2.1 → 0.9.6) + added a note that the
  field auto-fills from reflex.__version__.
- Cross-referenced the parity ledger explicitly so readers can sanity-
  check their own runs against the shipped numbers (SmolVLA 5.96e-07,
  pi0 2.09e-07, pi0.5 2.38e-07, GR00T 8.34e-07).
- Renamed file from understanding_verification.md to verification.md
  for consistency with sibling docs (eval.md, embodiment_schema.md).
- Replaced broken TROUBLESHOOTING.md cross-ref with reflex doctor flow.
- Kept the 'Interpreting results by vertical' table — verticals match
  the FastCrest customer research vault's P0 tier.
- Added 'Files' section preamble (Total: N files, X size) that #130
  omitted but the live renderer emits.

Supersedes #130.

Co-Authored-By: Divyansh Rawat <186957976+DsThakurRawat@users.noreply.github.com>
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@rylinjames rylinjames merged commit 46fbe3a into main May 15, 2026
6 checks passed
@rylinjames rylinjames deleted the docs/verification-trust-receipt branch May 15, 2026 23:59
rylinjames added a commit that referenced this pull request May 16, 2026
 #63) (#137)

Adds docs/troubleshooting.md with the most common error signatures and
fixes Reflex users hit on edge devices, cloud GPUs, ROS2 robots, and
drones. Structure: CUDA/GPU → Jetson → ROS2 bridge → Drone/MAVROS →
Export/validation → Registry → Quick diagnostics.

Adapted from #129 — kept all the original error signatures and fix
patterns (they're real and useful). Only refreshed:
- onnxruntime-gpu pin: 1.18.0 → >=1.25.1 (matches v0.9.2 floor)
- cuDNN floor: 9.0+ → 9.5+ (matches v0.9.2 floor)
- Driver floor: R525+ → R555+ for cuDNN 9.5+ (per v0.9.4 doctor guard)
- Added Blackwell sm_120 section (RTX 5090 / B200) per v0.9.3 guard
- Added the four v0.9.4 reflex doctor guards as the prescribed first
  step on any failure (multi-GPU arch, Jetson R35, cuDNN/driver skew,
  TRT EP empirical session test)
- Replaced #129's reference to PR #121 with the actual shipped
  --state-msg-type flag from #133 (joint_state/imu/odom dispatch)
- Updated cross-ref from understanding_verification.md → verification.md
  (renamed in #136)
- Updated cross-ref to adding_a_robot.md (shipped in #135)
- File renamed TROUBLESHOOTING.md → troubleshooting.md for consistency
  with sibling docs (lowercase, no ALL_CAPS)

Supersedes #129.

Co-authored-by: Divyansh Rawat <186957976+DsThakurRawat@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Docs] How-to: Reading your VERIFICATION.md

1 participant