Skip to content

Commit 3de97bf

Browse files
committed
fixed the kwargs passing to build_decode_specialization
Signed-off-by: Onkar Chougule <ochougul@qti.qualcomm.com>
1 parent ced0683 commit 3de97bf

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

QEfficient/transformers/models/modeling_auto.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2834,6 +2834,7 @@ def build_decode_specialization(
28342834
kv_cache_batch_size: Optional[int] = None,
28352835
full_batch_size: Optional[int] = None,
28362836
num_speculative_tokens: Optional[int] = None,
2837+
**kwargs,
28372838
):
28382839
"""
28392840
Builds a dictionary representing a compilation specialization for the decode phase.

0 commit comments

Comments
 (0)