Skip to content

feat: Upgrade to transformers v5#629

Merged
vivekkalyan merged 4 commits intomainfrom
feat/transformers-v5
Mar 24, 2026
Merged

feat: Upgrade to transformers v5#629
vivekkalyan merged 4 commits intomainfrom
feat/transformers-v5

Conversation

@vivekkalyan
Copy link
Copy Markdown
Collaborator

@vivekkalyan vivekkalyan commented Mar 23, 2026

This PR upgrades transformers v5 in ART by using a fork of vLLM: https://github.com/vivekkalyan/vllm/releases/tag/v0.17.0-art1

Some patches in our ART runtime are needed to make transformersv5/Qwen3.5 work:

  • Patch 1: make Transformers v5 rope config parsing not crash.
  • Patch 2: make Qwen3 VL MoE config look like what vLLM expects.
  • Patch 3: make Qwen3.5 fused GDN LoRA actually work in vLLM.

As well as some tokenizer shape changes to convert the newer tokenizer return shapes back into the old “token ids list” contract that the rest of preprocessing already expects.

@vivekkalyan vivekkalyan marked this pull request as ready for review March 23, 2026 22:45
@vivekkalyan vivekkalyan force-pushed the feat/transformers-v5 branch from 04d11ad to 3cb3fcc Compare March 24, 2026 00:26
@vivekkalyan vivekkalyan merged commit 3e50ca0 into main Mar 24, 2026
5 checks passed
@vivekkalyan vivekkalyan deleted the feat/transformers-v5 branch March 24, 2026 00:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants