Skip to content

Refactor autoregressive model tests#1486

Open
pstjohn wants to merge 1 commit intoNVIDIA:mainfrom
pstjohn:pstjohn/refactor-generation-tests
Open

Refactor autoregressive model tests#1486
pstjohn wants to merge 1 commit intoNVIDIA:mainfrom
pstjohn:pstjohn/refactor-generation-tests

Conversation

@pstjohn
Copy link
Collaborator

@pstjohn pstjohn commented Feb 28, 2026

Moves shared auto-regressive model tests to modeling_common, making it easier to add new auto-regressive models

Summary by CodeRabbit

  • Tests

    • Expanded test suite with comprehensive generation testing for autoregressive models, including batched and beam search scenarios.
    • Enhanced test configuration flexibility with additional parameter override support.
  • Bug Fixes

    • Improved numerical stability in expert routing calculations by maintaining float32 precision.

@coderabbitai
Copy link
Contributor

coderabbitai bot commented Feb 28, 2026

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment

Comment @coderabbitai help to get the list of available commands and usage tips.

@pstjohn pstjohn mentioned this pull request Feb 28, 2026
Signed-off-by: Peter St. John <pstjohn@nvidia.com>
@pstjohn pstjohn force-pushed the pstjohn/refactor-generation-tests branch from 2dad2a4 to ef39689 Compare February 28, 2026 15:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant