Feat: Delta Sparse Attention#90

Merged

gmlwns2000 merged 114 commits intodeepauto/devfrom

research/delta-qsa

Oct 3, 2025

Commits on Aug 11, 2025

fix
gmlwns2000
committed

Commits on Aug 12, 2025

fix self extend delta
gmlwns2000
committed
fit gpt oss
gmlwns2000
committed
disable delta glm
gmlwns2000
committed
added block sums and bsa index to query sparse attention

jeffwillette
authored and
gmlwns2000
committed
refactor
gmlwns2000
committed
refactor
gmlwns2000
committed
fixed bug in test code

jeffwillette
authored and
gmlwns2000
committed
changed bsa_block_size_q default arg to 1

jeffwillette
authored and
gmlwns2000
committed
commit before incorporating changes into upstream branch

jeffwillette
authored and
gmlwns2000
committed
fix
gmlwns2000
committed
wow
gmlwns2000
committed
add visualization
gmlwns2000
committed
fix
gmlwns2000
committed
update
gmlwns2000
committed
fix bug
gmlwns2000
committed

Commits on Aug 13, 2025

Commits on Aug 18, 2025

Commits on Aug 19, 2025

added implementation of winner min-heap inside qsa

jeffwillette
authored and
gmlwns2000
committed
debugging using_exp_sum bug

jeffwillette
authored and
gmlwns2000
committed
qsa winner heap working here

jeffwillette
authored and
gmlwns2000
committed
minor cleanup on qsa code.

jeffwillette
authored and
gmlwns2000
committed
heap verified to return same indices as plain online top-k

jeffwillette
authored and
gmlwns2000
committed
reordered code for minor cleanup

jeffwillette
authored and
gmlwns2000
committed
reordered the qsa top-k loop

jeffwillette
authored and
gmlwns2000
committed
cleaned up qsa kernel and added tests

jeffwillette
authored and
gmlwns2000
committed
added back in full hip/bsa tests

jeffwillette
authored and
gmlwns2000
committed
fmt
gmlwns2000
committed
what is happend here :(
gmlwns2000
committed
fix to use int32 in QSA masking
gmlwns2000
committed
fix autotune
gmlwns2000
committed
chnage score to fp32
gmlwns2000
committed
wip
daniel-geon-park
committed

Commits on Aug 20, 2025

Commits on Aug 23, 2025

fix
gmlwns2000
committed
added implementation of winner min-heap inside qsa

jeffwillette
authored and
gmlwns2000
committed
debugging using_exp_sum bug

jeffwillette
authored and
gmlwns2000
committed
qsa winner heap working here

jeffwillette
authored and
gmlwns2000
committed
heap verified to return same indices as plain online top-k

jeffwillette
authored and
gmlwns2000
committed
reordered code for minor cleanup

jeffwillette
authored and
gmlwns2000
committed
reordered the qsa top-k loop

jeffwillette
authored and
gmlwns2000
committed
cleaned up qsa kernel and added tests

jeffwillette
authored and
gmlwns2000
committed
added back in full hip/bsa tests

jeffwillette
authored and
gmlwns2000
committed
fixed bugs in qsa top-k's

jeffwillette
authored and
gmlwns2000
committed
removed block pointers from qsa kernel

jeffwillette
authored and
gmlwns2000
committed
converted pointers to all int64

jeffwillette
authored and
gmlwns2000
committed
fix
gmlwns2000
committed
removed functions which snuck in via rebase
jeffwillette
committed
wip
daniel-geon-park
committed
add EXACT_K
daniel-geon-park
committed
wip
daniel-geon-park
committed
Merge remote-tracking branch 'origin/research/delta-qsa' into feat/delta-bsa-geon
daniel-geon-park
committed

Commits on Aug 24, 2025

Commits on Aug 25, 2025

wip
daniel-geon-park
committed

Commits on Aug 27, 2025

Commits on Sep 2, 2025

fix
gmlwns2000
committed
Merge pull request #83 from DeepAuto-AI/feat/delta-qsa-ain
gmlwns2000
authored
add row_sums, row_sums_bsa

daniel-geon-park
authored and
gmlwns2000
committed
fix estimation

daniel-geon-park
authored and
gmlwns2000
committed
add overestimate_factor

daniel-geon-park
authored and
gmlwns2000
committed
testing

daniel-geon-park
authored and
gmlwns2000
committed
fix bug
gmlwns2000
committed
fix
gmlwns2000
committed
fmt
gmlwns2000
committed
Merge pull request #84 from DeepAuto-AI/feat/delta-qsa-geon
gmlwns2000
authored
fix reverse_iter environment variable bug
daniel-geon-park
committed

Commits on Sep 8, 2025

added e2e latency update
jeffwillette
committed

Commits on Sep 10, 2025

fixed autotune dirty init
jeffwillette
committed

Commits on Sep 13, 2025

Commits on Sep 15, 2025

fix
gmlwns2000
committed

Commits on Sep 25, 2025

fix
gmlwns2000
committed

Commits on Oct 1, 2025

fmt
gmlwns2000
committed