Skip to content

Enable symbolic values and count recompiles in benchmark scripts #2801

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
shino16 wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Enable symbolic values and count recompiles in benchmark scripts #2801

shino16 wants to merge 1 commit into from

Conversation

@shino16
Copy link
Collaborator

@shino16 shino16 commented Dec 13, 2025

  • Added --thunder-cache option to benchmark_peft.py and benchmark_litgpt.py
  • Added a benchmark metric "Thunder module recompilations excluding initial compile" to the above two and benchmark_inference.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mruberry mruberry Awaiting requested review from mruberry mruberry is a code owner

@lantiga lantiga Awaiting requested review from lantiga lantiga is a code owner

@KaelanDt KaelanDt Awaiting requested review from KaelanDt KaelanDt is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@shino16