Skip to content

[Feature]: update the TRT-llm bench hard code version to match the TRT-llm version. #11560

@pst2154

Description

@pst2154

🚀 The feature, motivation and pitch

https://github.com/NVIDIA/TensorRT-LLM/blob/main/tensorrt_llm/bench/benchmark/utils/general.py#L172

is hardcoded as 1.2 so TRT-llm bench says version 1.2 no matter what.
TensorRT LLM Version: 1.2 Dtype: bfloat16 KV Cache Dtype: FP8 Quantization: NVFP4

Alternatives

match the TRT-llm version

Additional context

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

Metadata

Metadata

Assignees

Labels

feature requestNew feature or request. This includes new model, dtype, functionality support

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions