Skip to content

Corpus4008: 24 additional disjoint source shards with 8 parallel hosted runners - #385

Draft
merynz wants to merge 1 commit into
corpus4008-wave1-source-rig-semantic-inventory-v1-20261107from
corpus4008-wave2-24shard-parallel-import-v1-20261107
Draft

merynz wants to merge 1 commit into
corpus4008-wave1-source-rig-semantic-inventory-v1-20261107from
corpus4008-wave2-24shard-parallel-import-v1-20261107

Conversation

@merynz

@merynz merynz commented Nov 7, 2026

Copy link
Copy Markdown
Owner

Actual throughput expansion

Wave1 PR #384: 8 shard jobs × 8 candidates; max-parallel 4.
Wave2: the remaining 24 independent shard indices × 8 candidates; max-parallel 8.

  • All 32 source recovery shards covered with disjoint canonical identity IDs (up to 256 FIT candidates across two waves).
  • Each original file read with SHA and byte-size check; Blender 4.5.14 pinned, isolated per-source process and source autoexec disabled.
  • Full imported mesh, material, sampled skin, armatures, IK, drivers and action curves stored as observation-only private Drive receipts.
  • Wave1 and Wave2 have independent run IDs and output paths. cancel-in-progress: false prevents active batches from being discarded by pushes.
  • This is not semantic/Graphics source truth or training admission; 2D graphics target requires independently reviewed art.

Workflow: https://github.com/merynz/RealSaS-OPT/actions/runs/42388620135
No writes to main, original Corpus370 or dataset teacher authority.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant