Clean up Voxtral Realtime HF weights after export#18289
Conversation
The downloaded model_weights/ directory (~20GB) was not removed after export, causing it to be uploaded to S3 as part of the CI artifact. Delete it after copying out the tokenizer since the weights are fully baked into the .pte at that point.
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/18289
Note: Links to docs will display an error until the docs builds have been completed. ❌ 1 Awaiting Approval, 2 New Failures, 51 PendingAs of commit 0186941 with merge base 5e265e6 ( NEW FAILURES - The following jobs have failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
There was a problem hiding this comment.
Pull request overview
Removes the large HuggingFace-downloaded Voxtral Realtime model_weights/ directory after export so it doesn’t get included in CI artifacts/S3 uploads, while still preserving the tokenizer needed at runtime.
Changes:
- Copy
tekken.jsontokenizer into the output artifact directory. - Delete the downloaded
model_weights/directory after export forvoxtral_realtime.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
You can also share your feedback on Copilot code review. Take the survey.
This PR needs a
|
|
@pytorchbot cherry-pick --onto release/1.2 -c release |
The downloaded model_weights/ directory (~20GB) was not removed after export, causing it to be uploaded to S3 as part of the CI artifact. Delete it after copying out the tokenizer since the weights are fully baked into the .pte at that point. (cherry picked from commit d9b394a)
Cherry picking #18289The cherry pick PR is at #18357 The following tracker issues are updated: Details for Dev Infra teamRaised by workflow job |
The downloaded model_weights/ directory (~20GB) was not removed
after export, causing it to be uploaded to S3 as part of the CI
artifact. Delete it after copying out the tokenizer since the
weights are fully baked into the .pte at that point.