Skip to content

Add SGLang engine routes for weight updates#9

Open
mvillmow wants to merge 8 commits intomainfrom
issue2-weight-routes
Open

Add SGLang engine routes for weight updates#9
mvillmow wants to merge 8 commits intomainfrom
issue2-weight-routes

Conversation

@mvillmow
Copy link
Copy Markdown
Collaborator

@mvillmow mvillmow commented Apr 22, 2026

Summary

Testing

  • not run in this PR worktree
  • extracted from the validated local change set

@mvillmow
Copy link
Copy Markdown
Collaborator Author

mvillmow commented Apr 22, 2026

Upstream tracker for this PR: ai-dynamo#8547

@mvillmow
Copy link
Copy Markdown
Collaborator Author

mvillmow commented Apr 22, 2026

Upstream PR: ai-dynamo#8553

@mvillmow mvillmow force-pushed the issue2-weight-routes branch from 302a6f6 to 0c7e145 Compare April 27, 2026 16:49
@mvillmow mvillmow force-pushed the issue2-weight-routes branch 2 times, most recently from 490bff5 to e5d1b8f Compare April 28, 2026 18:55
nealvaidya and others added 8 commits April 28, 2026 12:33
@nealvaidya @claude
feat(recipes): add Nemotron-3-Nano-Omni vLLM aggregated recipe (ai-dy…
f71a2c2 
…namo#8799)

Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@hhzhang16
fix: exclude env-dynamic fields from planner_config.json serialization (
ab902a3 
ai-dynamo#8805)

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
@hhzhang16
fix: inject DYN_FORWARDPASS_METRIC_PORT into worker pods (ai-dynamo#8817
4cd7c2a 
)

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
@dmitry-tokarev-nv @claude
fix: Added retries to curl commands (ai-dynamo#8784)
3ef7b8f 
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@mvillmow
Add SGLang engine routes for weight updates
5076615 
Signed-off-by: Micah Villmow <4211002+mvillmow@users.noreply.github.com>
@mvillmow
Add unit tests for weight update engine routes
97bee2c 
Signed-off-by: Micah Villmow <4211002+mvillmow@users.noreply.github.com>
@mvillmow
Harden weight update routes for engine-less workers
e5e426a 
Signed-off-by: Micah Villmow <4211002+mvillmow@users.noreply.github.com>
@mvillmow
fix: apply SGLang route formatting
a9e0a3e 
Signed-off-by: Micah Villmow <4211002+mvillmow@users.noreply.github.com>
@mvillmow mvillmow force-pushed the issue2-weight-routes branch from e5d1b8f to a9e0a3e Compare April 28, 2026 22:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

actions backend::sglang backend::trtllm backend::vllm container deployment::k8s documentation Improvements or additions to documentation frontend multimodal planner router

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@mvillmow @nealvaidya @hhzhang16 @dmitry-tokarev-nv