-
Notifications
You must be signed in to change notification settings - Fork 50
Pull requests: gittensor-ai-lab/sparkinfer
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
perf(qwen36): Q8_0→Q4_K requant of GDN ssm_out projections (+2.8% @128)
#355
opened Jul 12, 2026 by
blinkeye-lcm
Contributor
Loading…
1 task done
perf(qwen36): opt-in Q8→Q4 requant reward profile (~+6.3% @512)
128-context
UI-only: strongest measured context in sparkinfer eval
area:kernels
subsystem (emission weight 0.42)
area:runtime
subsystem (emission weight 0.26)
eval:REJECT
sparkinfer auto-eval verdict: REJECT
eval-qwen35:REJECT
eval-qwen36:REJECT
test-on-5090
Maintainer-approved to evaluate on RTX 5090 (greenlight)
#350
opened Jul 12, 2026 by
andriypolanski
Loading…
4 of 6 tasks
perf(attn): grid-target KV-split cap for int8-MMA long-context decode
128-context
UI-only: strongest measured context in sparkinfer eval
area:runtime
subsystem (emission weight 0.26)
eval:none
sparkinfer auto-eval verdict: none
eval-qwen35:none
eval-qwen36:none
re-evaluate
Winner merged — rebase onto main; bot re-evaluates on push
test-on-5090
Maintainer-approved to evaluate on RTX 5090 (greenlight)
perf(qwen3.6): Q4_K on-read LM head for the 35B-A3B hybrid-MoE (reuses #329)
area:runtime
subsystem (emission weight 0.26)
needs-rebase
Verified speedup but not the round winner — rebase after merge-first lands
not-tested
Awaiting maintainer approval to run on RTX 5090; not evaluated
#308
opened Jul 10, 2026 by
minion1227
Loading…
fix(runtime): validate routed-expert tensor shapes in Qwen GGUF loader
area:runtime
subsystem (emission weight 0.26)
needs-rebase
Verified speedup but not the round winner — rebase after merge-first lands
not-tested
Awaiting maintainer approval to run on RTX 5090; not evaluated
#292
opened Jul 9, 2026 by
RealDiligent
Loading…
perf(qwen3.6): fuse Q-gate + O-proj Q8_1 quantize into one launch
128-context
UI-only: strongest measured context in sparkinfer eval
area:kernels
subsystem (emission weight 0.42)
area:runtime
subsystem (emission weight 0.26)
eval:none
sparkinfer auto-eval verdict: none
test-on-5090
Maintainer-approved to evaluate on RTX 5090 (greenlight)
#283
opened Jul 8, 2026 by
galuis116
Contributor
Loading…
1 task done
perf(decode): pack2 MMVQ for attention Q4_K Wq and O projections
128-context
UI-only: strongest measured context in sparkinfer eval
area:kernels
subsystem (emission weight 0.42)
area:runtime
subsystem (emission weight 0.26)
eval:none
sparkinfer auto-eval verdict: none
test-on-5090
Maintainer-approved to evaluate on RTX 5090 (greenlight)
#272
opened Jul 6, 2026 by
claytonlin1110
Contributor
Loading…
1 task done
perf(moe): Q5_K fp split-K Qwen specialization + gate_up F=512 dispatch (+4.3% Qwen3.6 decode)
128-context
UI-only: strongest measured context in sparkinfer eval
area:kernels
subsystem (emission weight 0.42)
area:runtime
subsystem (emission weight 0.26)
eval:M
sparkinfer auto-eval verdict: M
needs-rebase
Verified speedup but not the round winner — rebase after merge-first lands
test-on-5090
Maintainer-approved to evaluate on RTX 5090 (greenlight)
#267
opened Jul 6, 2026 by
inference2026
Contributor
•
Draft
1 task done
ProTip!
Follow long discussions with comments:>50.