Skip to content

Faster Qwen3.5#474

Draft
CC-Yeh wants to merge 1 commit into
mainfrom
qwen3_5_brrrrrr
Draft

Faster Qwen3.5#474
CC-Yeh wants to merge 1 commit into
mainfrom
qwen3_5_brrrrrr

Conversation

@CC-Yeh
Copy link
Copy Markdown
Contributor

@CC-Yeh CC-Yeh commented May 30, 2026

  • bf16 activations/conv states
  • coalesced decode state access

@CC-Yeh CC-Yeh changed the title bf16 activations/conv states + coalesced decode state access Faster Qwen3.5 May 30, 2026
@uuuvn
Copy link
Copy Markdown
Contributor

uuuvn commented May 30, 2026

We must match the precision in lalamo, gated delta net and mamba are sensitive to it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants