feat: Distributed inference (TP/PP) #37

Open

opened

It would be great to add support for single-node, multi-process inference to Tiny LLM.

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests