Add CI-safe sample JSON lockdown audit with palette-only visibility - PR 11.71

Author: DavidQ

docs/dev/codex_commands.md

@@ -1,8 +1,38 @@
-# Codex Command — PR 11.68
+# Codex Command — PR 11.71
 
 Model: GPT-5.4
 Reasoning: high
 
-```powershell
-codex exec --model gpt-5.4 --reasoning high "Apply docs/pr/PR_11_68_SAMPLE_JSON_AUDIT_LOCKDOWN.md exactly. Update only the audit script and required report files. Make default output counts-only, keep -Details for full listing, add -Ci failure mode for missing references, preserve CSV generation, run the listed validation commands, and write docs/dev/reports/PR_11_68_sample_json_audit_lockdown_report.md. Do not run the full samples suite."
+```text
+Implement PR 11.71 exactly as documented.
+
+Add scripts/PS/audit-sample-json-lockdown.ps1.
+
+Requirements:
+- Executable PowerShell only; no markdown/prose in the .ps1 file.
+- Must run from repo root.
+- Recursively scan samples/** sample leaf folders.
+- Count all JSON files under samples/**.
+- Determine referenced JSON files by scanning sample JS files for JSON filenames.
+- Report:
+  - JSON files scanned
+  - Referenced
+  - Missing reference
+  - Palette-only sample folders
+- Default mode: summary counts only.
+- -Details mode: dump missing reference paths and palette-only paths.
+- -Ci mode: exit 1 when Missing reference > 0, otherwise exit 0.
+- Keep generated CSV at docs/dev/reports/sample_json_lockdown_audit.csv.
+- Do not modify sample runtime code.
+- Do not modify roadmap text except status marker only if execution-backed.
+- Use targeted validation only; do not run full sample suite.
+
+After implementation, run:
+./scripts/PS/audit-sample-json-lockdown.ps1
+./scripts/PS/audit-sample-json-lockdown.ps1 -Details
+./scripts/PS/audit-sample-json-lockdown.ps1 -Ci
+
+If -Ci fails because current repo still has missing references, document that expected blocker in docs/dev/reports/PR_11_71_validation.md and do not hide it.
+
+Return repo-structured ZIP at tmp/PR_11_71_SAMPLE_JSON_LOCKDOWN.zip.
 ```

docs/dev/commit_comment.txt

@@ -1 +1 @@
-Lock sample JSON audit output and CI regression guard - PR 11.68
+Add CI-safe sample JSON lockdown audit with palette-only visibility - PR 11.71

docs/dev/reports/PR_11_71_validation.md

@@ -0,0 +1,36 @@
+# PR 11.71 Validation
+
+## Scope
+- Implemented `scripts/PS/audit-sample-json-lockdown.ps1`.
+- No sample runtime/tool/roadmap code changes.
+
+## Commands Run
+1. `./scripts/PS/audit-sample-json-lockdown.ps1`
+2. `./scripts/PS/audit-sample-json-lockdown.ps1 -Details`
+3. `./scripts/PS/audit-sample-json-lockdown.ps1 -Ci`
+
+## Results
+- Default mode:
+  - JSON files scanned: `66`
+  - Referenced: `66`
+  - Missing reference: `0`
+  - Palette-only sample folders: `5`
+  - Exit code: `0`
+- Details mode:
+  - Printed missing-reference path section (`none`)
+  - Printed palette-only folder paths
+  - Exit code: `0`
+- CI mode:
+  - Exit code: `0`
+  - No blocker triggered because missing references are `0`
+
+## CSV Output
+- Generated and preserved:
+  - `docs/dev/reports/sample_json_lockdown_audit.csv`
+
+## Blockers
+- None.
+- Note: if future runs produce `Missing reference > 0`, `-Ci` will exit `1` by design.
+
+## Full Suite
+- Full samples suite not run (targeted script validation only, per PR scope).

docs/dev/reports/pr_11_71_ci_output.txt

@@ -0,0 +1,3 @@
+default_exit=0
+details_exit=0
+ci_exit=0

docs/dev/reports/pr_11_71_default_output.txt

@@ -0,0 +1,67 @@
+"SampleLeaf","JsonPath","Referenced","ReferencedBy","IsPaletteJson","IsPaletteOnlySampleFolder"
+"samples\metadata","samples\metadata\samples.index.metadata.json","True","samples\index.render.js","False","False"
+"samples\phase-02\0204","samples\phase-02\0204\sample.0204.3d-asset-viewer.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-02\0204","samples\phase-02\0204\sample.0204.asset-browser.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-02\0207","samples\phase-02\0207\sample.0207.palette.json","True","samples\phase-02\0207\main.js","True","False"
+"samples\phase-02\0207","samples\phase-02\0207\sample.0207.sprite-editor.json","True","samples\phase-02\0207\AnimationSystemScene.js","False","False"
+"samples\phase-02\0213","samples\phase-02\0213\sample.0213.palette.json","True","samples\metadata\samples.index.metadata.json","True","False"
+"samples\phase-02\0213","samples\phase-02\0213\sample.0213.sprite-editor.json","True","samples\phase-02\0213\SpriteRenderLayerScene.js","False","False"
+"samples\phase-02\0214","samples\phase-02\0214\sample.0214.palette.json","True","samples\phase-02\0214\main.js","True","False"
+"samples\phase-02\0214","samples\phase-02\0214\sample.0214.sprite-editor.json","True","samples\phase-02\0214\AnimationSpriteBindingScene.js","False","False"
+"samples\phase-02\0219","samples\phase-02\0219\sample.0219.palette.json","True","samples\metadata\samples.index.metadata.json","True","False"
+"samples\phase-02\0219","samples\phase-02\0219\sample.0219.sprite-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-02\0221","samples\phase-02\0221\sample.0221.palette.json","True","samples\phase-02\0221\main.js","True","False"
+"samples\phase-02\0221","samples\phase-02\0221\sample.0221.tile-map-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-02\0221","samples\phase-02\0221\sample.0221.tile-model-converter.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-02\0221","samples\phase-02\0221\sample-0221-tile-map-editor-document.json","True","samples\phase-02\0221\sample.0221.tile-model-converter.json","False","False"
+"samples\phase-02\0224","samples\phase-02\0224\sample.0224.palette.json","True","samples\phase-02\0224\main.js","True","False"
+"samples\phase-02\0224","samples\phase-02\0224\sample.0224.sprite-editor.json","True","samples\phase-02\0224\TileCameraSpriteSliceScene.js","False","False"
+"samples\phase-02\0224","samples\phase-02\0224\sample.0224.tile-map-editor.json","True","samples\phase-02\0224\TileCameraSpriteSliceScene.js","False","False"
+"samples\phase-02\0224","samples\phase-02\0224\sample-0224-tile-map-editor-document.json","True","samples\phase-02\0224\main.js","False","False"
+"samples\phase-02\0226","samples\phase-02\0226\sample.0226.skin-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-02\0227","samples\phase-02\0227\sample.0227.skin-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-03\0301","samples\phase-03\0301\sample.0301.palette.json","True","samples\metadata\samples.index.metadata.json","True","False"
+"samples\phase-03\0301","samples\phase-03\0301\sample.0301.sprite-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-03\0302","samples\phase-03\0302\sample.0302.palette.json","True","samples\metadata\samples.index.metadata.json","True","False"
+"samples\phase-03\0302","samples\phase-03\0302\sample.0302.sprite-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-03\0305","samples\phase-03\0305\sample.0305.palette.json","True","samples\phase-03\0305\main.js","True","False"
+"samples\phase-03\0305","samples\phase-03\0305\sample.0305.tile-map-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-03\0305","samples\phase-03\0305\sample.0305.tile-model-converter.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-03\0305","samples\phase-03\0305\sample-0305-tile-map-editor-document.json","True","samples\phase-03\0305\sample.0305.tile-model-converter.json","False","False"
+"samples\phase-03\0308","samples\phase-03\0308\sample.0308.palette.json","True","samples\metadata\samples.index.metadata.json","True","True"
+"samples\phase-03\0313","samples\phase-03\0313\sample.0313.palette.json","True","samples\metadata\samples.index.metadata.json","True","True"
+"samples\phase-09\0901","samples\phase-09\0901\sample.0901.palette.json","True","samples\metadata\samples.index.metadata.json","True","True"
+"samples\phase-09\0905","samples\phase-09\0905\sample.0905.palette.json","True","samples\metadata\samples.index.metadata.json","True","False"
+"samples\phase-09\0905","samples\phase-09\0905\sample.0905.sprite-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1204","samples\phase-12\1204\sample.1204.palette.json","True","samples\metadata\samples.index.metadata.json","True","True"
+"samples\phase-12\1205","samples\phase-12\1205\sample.1205.palette.json","True","samples\phase-12\1205\main.js","True","True"
+"samples\phase-12\1208","samples\phase-12\1208\sample.1208.palette.json","True","samples\metadata\samples.index.metadata.json","True","False"
+"samples\phase-12\1208","samples\phase-12\1208\sample.1208.parallax-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1208","samples\phase-12\1208\sample.1208.svg-asset-studio.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1208","samples\phase-12\1208\sample.1208.tile-map-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1209","samples\phase-12\1209\sample.1209.palette.json","True","samples\phase-12\1209\presetReferences.js","True","False"
+"samples\phase-12\1209","samples\phase-12\1209\sample.1209.tile-map-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1209","samples\phase-12\1209\sample.1209.tile-model-converter.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1209","samples\phase-12\1209\sample-1209-tile-map-editor-document.json","True","samples\phase-12\1209\sample.1209.tile-model-converter.json","False","False"
+"samples\phase-12\1210","samples\phase-12\1210\sample.1210.palette.json","True","samples\phase-12\1210\presetReferences.js","True","False"
+"samples\phase-12\1210","samples\phase-12\1210\sample.1210.tile-map-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1210","samples\phase-12\1210\sample-1210-tile-map-editor-document.json","True","samples\phase-12\1210\presetReferences.js","False","False"
+"samples\phase-12\1211","samples\phase-12\1211\sample.1211.palette.json","True","samples\phase-12\1211\presetReferences.js","True","False"
+"samples\phase-12\1211","samples\phase-12\1211\sample.1211.tile-map-editor.json","True","samples\phase-12\1211\index.html","False","False"
+"samples\phase-12\1211","samples\phase-12\1211\sample-1211-tile-map-editor-document.json","True","samples\phase-12\1211\presetReferences.js","False","False"
+"samples\phase-12\1212","samples\phase-12\1212\sample-1212-vector-map-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1213","samples\phase-12\1213\sample-1213-vector-map-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1214","samples\phase-12\1214\sample-1214-vector-map-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1215","samples\phase-12\1215\sample-1215-svg-asset-studio.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1216","samples\phase-12\1216\sample-1216-svg-asset-studio.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1217","samples\phase-12\1217\sample-1217-svg-asset-studio.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1218","samples\phase-12\1218\sample-1218-parallax-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1219","samples\phase-12\1219\sample-1219-parallax-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-12\1220","samples\phase-12\1220\sample-1220-parallax-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-14\1413","samples\phase-14\1413\sample.1413.3d-asset-viewer.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-14\1413","samples\phase-14\1413\sample.1413.asset-browser.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-14\1413","samples\phase-14\1413\sample.1413.asset-pipeline-tool.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-14\1414","samples\phase-14\1414\sample.1414.palette.json","True","samples\metadata\samples.index.metadata.json","True","False"
+"samples\phase-14\1414","samples\phase-14\1414\sample.1414.sprite-editor.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-15\1505","samples\phase-15\1505\sample.1505.asset-browser.json","True","samples\metadata\samples.index.metadata.json","False","False"
+"samples\phase-19\1902","samples\phase-19\1902\sample.1902.workspace-all-tools.json","True","samples\index.render.js","False","False"

docs/dev/reports/pr_11_71_details_output.txt

@@ -0,0 +1,16 @@
+# PR 11.70 - Fix palette-only sample audit script
+
+Purpose: replace broken prose-contaminated PowerShell with a clean executable script.
+
+Scope:
+- Recursively scan samples/** leaf sample folders.
+- Print paths where the only JSON files are *.palette.json.
+- Print the total count at the end.
+- Export CSV to docs/dev/reports/samples_only_palette_json_audit.csv.
+
+Validation:
+```powershell
+.\scripts\PS\audit-samples-only-palette-json.ps1
+```
+
+Do not run the full samples smoke test.