Skip to content

Conversation

@ananthsub
Copy link

Fixes #292

This PR covers the rollout collection within NeMo Gym for standalone usage (ie not used in conjuction with an RL training framework). For the NeMo RL + Gym integration summary, I will add docs to the NeMo RL page, and update Gym docs with a pointer to those for reference.

These docs cover:

  • Control plane: ng_run startup sequence (CLI parsing, config loading, Ray init, server spawning)
  • Server architecture: Head server, uvicorn/FastAPI initialization
  • HTTP request flow: Example rollout showing Agent -> Model -> Resources interactions
  • Data plane: ng_collect_rollouts flow starting from the headserver discovery

This change also adds an extra dependency on sphinxcontrib.mermaid for mermaid diagrams to render in the docs page

Signed-off-by: Ananth Subramaniam <ansubramania@nvidia.com>
Signed-off-by: Ananth Subramaniam <ansubramania@nvidia.com>
@ananthsub ananthsub added the documentation Improvements to documentation label Jan 12, 2026
@copy-pr-bot
Copy link

copy-pr-bot bot commented Jan 12, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Architecture Diagram and Clarify NeMo Gym + NeMo RL Integration

1 participant