chore(deps-dev): bump accelerate from 0.30.1 to 1.10.1

[dependabot]

Warning

Dependabot will stop supporting python v3.9!

Please upgrade to one of the following versions: v3.9, v3.10, v3.11, v3.12, v3.13, or v3.14.

Bumps accelerate from 0.30.1 to 1.10.1.

Release notes

Sourced from accelerate's releases.

v1.10.1: Patchfix

• Feat: add to_json by @​S1ro1 in huggingface/accelerate#3743
• Protect import for device_mesh by @​SunMarc in huggingface/accelerate#3742.

Full Changelog: huggingface/accelerate@v1.10.0...v1.10.1

v1.10.0: N-D Parallelism

N-D Parallelism

Training large models across multiple GPUs can be complex, especially when combining different parallelism strategies (e.g TP, CP, DP). To simplify this process, we've collaborated with Axolotl to introduce an easy-to-use integration that allows you to apply any combination of parallelism strategies directly in your training script. Just pass a ParallelismConfig specifying the size of each parallelism type—it's that simple. Learn more about how it works in our latest blogpost.

parallelism_config = ParallelismConfig(
    dp_shard_size=2,
    dp_replicate_size=2,
    cp_size=2,
    tp_size=2,
)
accelerator = Accelerator(
    parallelism_config=parallelism_config,
   ...
)
model = AutoModelForCausalLM.from_pretrained("your-model-name", device_mesh=accelerator.torch_device_mesh)
model = accelerator.prepare(model)

• Parallelism config + TP + HSDP + BYODM (Bring Your Own Device Mesh) by @​SalmanMohammadi in huggingface/accelerate#3682
• Feat: context parallel v2.0 by @​S1ro1 in huggingface/accelerate#3700
• set default submesh_tp_size to prevent unset local variable error by @​winglian in huggingface/accelerate#3687
• Add Parallelism getter property to Accelerator class by @​WoosungMyung in huggingface/accelerate#3703
• Fix: prepare works even if nothing except tp specified (rare) by @​S1ro1 in huggingface/accelerate#3707
• Set parallelism_config in constructor due to Trainer reset of State by @​winglian in huggingface/accelerate#3713
• Fix: tp size wouldn't read from env by @​S1ro1 in huggingface/accelerate#3716
• Remove ParallelismConfig from PartialState by @​SunMarc in huggingface/accelerate#3720

FSDP improvements

We've fixed ignored modules attribute. With this, it is now possible to train PEFT model that moe layers that contrains q_proj and v_proj parameters. This is especially important for fine-tuning gpt-oss model.

• ENH: Allow FSDP ignored modules to be regex by @​BenjaminBossan in huggingface/accelerate#3698
• TST Add test for FSDP ignored_modules as str by @​BenjaminBossan in huggingface/accelerate#3719

Minor improvements

• feature: CpuOffload pre_forward don't attempt to move if already on device by @​JoeGaffney in huggingface/accelerate#3695
• Fix: Ensure environment variable values are case-insensitive in Accelerate by @​jp1924 in huggingface/accelerate#3712
• remove use_ipex by @​SunMarc in huggingface/accelerate#3721

New Contributors

... (truncated)

Commits

• 623cc0b Release: v1.10.1
• d73e921 Protect import for device_mesh (#3742)
• f4593e3 Feat: add to_json (#3743)
• 5dcd16e Release: v1.10.0
• 2941a6b remove (#3721)
• c0a3aef feature: CpuOffload pre_forward don't attempt to move if already on device (#...
• 42fdda1 Remove ParallelismConfig from PartialState (#3720)
• e23b004 TST Add test for FSDP ignored_modules as str (#3719)
• 898cad3 Fix: tp size wouldn't read from env (#3716)
• 24c8157 Set parallelism_config in constructor due to Trainer reset of State (#3713)
• Additional commits viewable in compare view