Skip to content

Source frontend/runtime should tolerate ai-dynamo-runtime 1.0.0 binding surface differences #7

@mvillmow

Description

@mvillmow

Summary
The source-backed frontend and SGLang integration currently assume newer runtime symbols and method signatures than the shipped ai-dynamo-runtime==1.0.0 bindings expose.

Observed mismatches

  • optional import surface such as AicPerfConfig
  • RouterConfig / KvRouterConfig constructor kwargs drift
  • WorkerMetricsPublisher.publish signature drift
  • ModelRuntimeConfig fields only present in newer builds
  • EngineShutdown import path drift

Why this matters
These mismatches block source-backed validation and make it hard to test runtime fixes in the RL360 harness without patching the source tree locally.

Desired outcome
Harden the Python frontend/SGLang integration to degrade gracefully when older runtime bindings are present instead of crashing at import or constructor time.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions