Skip to content

Conversation

@Lumosis
Copy link
Collaborator

@Lumosis Lumosis commented Dec 10, 2025

Description

When using EP, the total number of tpus becomes tensor_parallel_size * expert_parallel_size

Tests

Please describe how you tested this change, and include any instructions and/or
commands to reproduce.

Checklist

Before submitting this PR, please make sure:

  • I have performed a self-review of my code.
  • I have necessary comments in my code, particularly in hard-to-understand areas.
  • I have made or will make corresponding changes to any relevant documentation.

@Lumosis Lumosis requested review from Chenyaaang and removed request for mrjunwan-lang and sixiang-google December 10, 2025 22:31
@github-actions
Copy link

Description

Start with a short description of what the PR does and how this is a change from
the past.

The rest of the description includes relevant details and context, examples:

  • why is this change being made,
  • the problem being solved and any relevant context,
  • why this is a good solution,
  • some information about the specific implementation,
  • shortcomings of the solution and possible future improvements.

If the change fixes a Github issue, please include a link, e.g.,:
FIXES: #123456

Tests

Please describe how you tested this change, and include any instructions and/or
commands to reproduce.

Checklist

Before submitting this PR, please make sure:

  • I have performed a self-review of my code.
  • I have necessary comments in my code, particularly in hard-to-understand areas.
  • I have made or will make corresponding changes to any relevant documentation.

@Lumosis Lumosis force-pushed the lihao/pp branch 2 times, most recently from a2e9684 to 7141daf Compare December 15, 2025 23:22
@Chenyaaang Chenyaaang added the ready ONLY add when PR is ready to merge/full CI is needed label Dec 15, 2025
Signed-off-by: Lihao Ran <imlihao.ran@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants