Search results

[New Model]: Support Qwen3.5 model in torch backend

new modelRequest to add a new modelRequest to add a new model

Pytorch<NV>Pytorch backend related issues<NV>Pytorch backend related issues

Status: Open.

#11674 In NVIDIA/TensorRT-LLM;

· RobertLou opened on Feb 24, 2026

[Bug]: Incorrect detection order for model_dir type causes IN_MEMORY loading failure

bugSomething isn't workingSomething isn't working

Inference runtime<NV>General operational aspects of TRTLLM execution not in other categories.<NV>General operational aspects of TRTLLM execution not in other categories.

Status: Open.

#11666 In NVIDIA/TensorRT-LLM;

· capyun007 opened on Feb 24, 2026

[RFC]: User Telemetry in TensorRT LLM

RFC

Status: Open.

#11659 In NVIDIA/TensorRT-LLM;

· arysef opened on Feb 23, 2026

[Feature][AutoDeploy]: Explore optimal sharding configurations

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#11656 In NVIDIA/TensorRT-LLM;

· greg-kwasniewski1 opened on Feb 23, 2026

[AutoDeploy]: Perf sweep SuperV3 nvfp4 with large workloads and identify perf gaps

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#11642 In NVIDIA/TensorRT-LLM;

· galagam opened on Feb 23, 2026

[Bug]: trtllm-serve crashes with std::bad_cast when eos_token_id is a list (Llama 3.1)

bugSomething isn't workingSomething isn't working

Status: Open.

#11625 In NVIDIA/TensorRT-LLM;

· CristyNel opened on Feb 22, 2026

[Bug]: [trtllm-gen fmha] Missing OE2m1 ForGen VarSeqQ32/64/128 kernels + E2M1 hard-gated selector causes high-throughput decode regression

bugSomething isn't workingSomething isn't working

Customized kernels<NV>Specialized/modified CUDA kernels in TRTLLM for LLM ops, beyond standard TRT. Dev & perf.<NV>Specialized/modified CUDA kernels in TRTLLM for LLM ops, beyond standard TRT. Dev & perf.

Status: Open.

#11620 In NVIDIA/TensorRT-LLM;

· baonudesifeizhai opened on Feb 22, 2026

[Bug]: Multi GPU tests failing silently

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

bugSomething isn't workingSomething isn't working

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Scale-out<NV>Multi-GPU and distributed inference scaling issues, tensor/pipeline/data parallelism<NV>Multi-GPU and distributed inference scaling issues, tensor/pipeline/data parallelism

Testing<NV>Continuous integration, build system, and testing infrastructure issues<NV>Continuous integration, build system, and testing infrastructure issues

Status: Open.

#11614 In NVIDIA/TensorRT-LLM;

· greg-kwasniewski1 opened on Feb 21, 2026

[Feature]: Update sharding config dims

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Scale-out<NV>Multi-GPU and distributed inference scaling issues, tensor/pipeline/data parallelism<NV>Multi-GPU and distributed inference scaling issues, tensor/pipeline/data parallelism

Status: Open.

#11583 In NVIDIA/TensorRT-LLM;

· greg-kwasniewski1 opened on Feb 19, 2026

[Bug] v1.3.0rc4 claims Qwen3-VL support but convert_checkpoint.py throws AssertionError

bugSomething isn't workingSomething isn't working

Model customization<NV>Adding support for new model architectures or variants<NV>Adding support for new model architectures or variants

Status: Open.

#11569 In NVIDIA/TensorRT-LLM;

· CristyNel opened on Feb 18, 2026

[Feature]: Remove torch.distributed from template_moe all_to_all

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#11568 In NVIDIA/TensorRT-LLM;

· greg-kwasniewski1 opened on Feb 18, 2026

[Feature]: update the TRT-llm bench hard code version to match the TRT-llm version.

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#11560 In NVIDIA/TensorRT-LLM;

· pst2154 opened on Feb 18, 2026