Skip to content

Add large-scale AutoSharding example #9

@jeffcarp

Description

@jeffcarp

E.g. Gemma 27B.

Potentially switch to this implementation:
https://github.com/jax-ml/bonsai/tree/main/bonsai/models/gemma3

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions