Skip to content

docs: surface Transformers Trainer → HF Buckets#2528

Draft
davanstrien wants to merge 3 commits into
mainfrom
transformers-trainer-buckets
Draft

docs: surface Transformers Trainer → HF Buckets#2528
davanstrien wants to merge 3 commits into
mainfrom
transformers-trainer-buckets

Conversation

@davanstrien

@davanstrien davanstrien commented Jun 4, 2026

Copy link
Copy Markdown
Member

Draft — depends on huggingface/transformers#46386 ("HF Buckets integration to Trainer") being merged and its docs deploying.

What

Surfaces the new Trainer → HF Buckets checkpoint support in the Hub buckets docs, so users (and other libraries) see that buckets are a first-class checkpoint store:

  • storage-buckets.md — Tip in the Training checkpoints and logs use case
  • storage-buckets-integrations.md — new 🤗 Transformers section

Link-forward and minimal: the canonical push_to_bucket= snippet stays in the transformers Trainer docs to avoid drift while the upstream API may still change before merge.

Pre-merge checklist

  • transformers#46386 merged + docs deployed
  • confirm/tighten the Trainer docs link + section anchor
  • mark ready for review

🤖 Generated with Claude Code

Add a link-forward mention of `Trainer`'s native HF Buckets checkpoint
support (transformers#46386) to the buckets docs:
- storage-buckets.md: Tip in the "Training checkpoints and logs" use case
- storage-buckets-integrations.md: new "🤗 Transformers" section

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Comment thread docs/hub/storage-buckets.md Outdated
Comment on lines +337 to +338
> [!TIP]
> 🤗 Transformers' [`Trainer`](https://huggingface.co/docs/transformers/trainer_recipes) can push and resume training checkpoints directly to a bucket — no manual `sync` step needed. See the Trainer docs for setup.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice 👍

Comment thread docs/hub/storage-buckets-integrations.md Outdated
Comment thread docs/hub/storage-buckets.md Outdated
davanstrien and others added 2 commits June 7, 2026 12:28
Co-authored-by: Julien Chaumond <julien@huggingface.co>
Co-authored-by: Julien Chaumond <julien@huggingface.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants