Skip to content

Apply PD model updates directly for endpoint enablement#15

Draft
mvillmow wants to merge 5 commits intomainfrom
issue8-pd-endpoint-enable
Draft

Apply PD model updates directly for endpoint enablement#15
mvillmow wants to merge 5 commits intomainfrom
issue8-pd-endpoint-enable

Conversation

@mvillmow
Copy link
Copy Markdown
Collaborator

@mvillmow mvillmow commented Apr 22, 2026

Summary

Testing

  • local runtime rebuild still in progress in the validation environment
  • opening as draft until the rebuilt source path is revalidated

@mvillmow
Copy link
Copy Markdown
Collaborator Author

mvillmow commented Apr 22, 2026

Upstream tracker for this PR: ai-dynamo#8552

@mvillmow
Copy link
Copy Markdown
Collaborator Author

mvillmow commented Apr 22, 2026

Upstream PR: ai-dynamo#8558

@mvillmow mvillmow force-pushed the issue8-pd-endpoint-enable branch from 1a3660e to 874afb4 Compare April 27, 2026 19:30
@mvillmow mvillmow force-pushed the issue8-pd-endpoint-enable branch 3 times, most recently from 6608545 to f569dd5 Compare April 28, 2026 18:57
nealvaidya and others added 5 commits April 28, 2026 12:33
@nealvaidya @claude
feat(recipes): add Nemotron-3-Nano-Omni vLLM aggregated recipe (ai-dy…
f71a2c2 
…namo#8799)

Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@hhzhang16
fix: exclude env-dynamic fields from planner_config.json serialization (
ab902a3 
ai-dynamo#8805)

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
@hhzhang16
fix: inject DYN_FORWARDPASS_METRIC_PORT into worker pods (ai-dynamo#8817
4cd7c2a 
)

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
@dmitry-tokarev-nv @claude
fix: Added retries to curl commands (ai-dynamo#8784)
3ef7b8f 
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@mvillmow
Apply PD model updates directly for endpoint enablement
c771012 
Signed-off-by: Micah Villmow <4211002+mvillmow@users.noreply.github.com>
@mvillmow mvillmow force-pushed the issue8-pd-endpoint-enable branch from f569dd5 to c771012 Compare April 28, 2026 22:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

actions backend::sglang backend::trtllm backend::vllm container deployment::k8s documentation Improvements or additions to documentation frontend multimodal planner router

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@mvillmow @nealvaidya @hhzhang16 @dmitry-tokarev-nv