Skip to content

feat: Qwen3 VLM support #443

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
bradhilton wants to merge 24 commits into
base: main
Choose a base branch
from
Draft

feat: Qwen3 VLM support #443

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
fdef126
chore: Start adding Math Vista task
bradhilton Sep 17, 2025
87de7f1
feat: Add text-only rollout function
bradhilton Sep 17, 2025
5297dd9
refactor: Simplify message handling in Math Vista notebook
bradhilton Sep 17, 2025
ff8bbb7
feat: Enhance Math Vista notebook with execution tracking and image h…
bradhilton Sep 17, 2025
e316551
fix: Update run data paths and timestamps in Math Vista notebook
bradhilton Sep 17, 2025
4a1c34e
fix: Reset execution counts and clean up outputs in Math Vista notebook
bradhilton Sep 17, 2025
657960e
Merge branch 'main' into feat/vlm-support
bradhilton Oct 14, 2025
030ff87
Merge branch 'main' into feat/vlm-support
bradhilton Oct 14, 2025
5343690
chore: Ruff linting autofix
bradhilton Oct 14, 2025
12124b0
chore: Cast types
bradhilton Oct 14, 2025
dbfbcd3
fix: Update execution counts and outputs in math-vista notebook
bradhilton Oct 14, 2025
9d426d2
refactor: Enhance image processing integration in tokenizer and backend
bradhilton Oct 15, 2025
f233b30
refactor: Enhance tensor handling in packing and tokenization
bradhilton Oct 15, 2025
170acda
refactor: Improve tensor handling and execution tracking in math-vist…
bradhilton Oct 15, 2025
9645b86
Merge branch 'main' into feat/vlm-support
bradhilton Oct 15, 2025
6a8977c
refactor: Optimize token indexing in trajectory tokenization
bradhilton Oct 15, 2025
b81c2dc
chore: Clean up math-vista.ipynb
bradhilton Oct 16, 2025
c0ab347
refactor: Improve LoRA handling in UnslothService and ModelState
bradhilton Oct 16, 2025
cf66a19
refactor: Enhance tensor handling in UnslothService during warmup
bradhilton Oct 16, 2025
01cd44f
feat: Add image generation and training notebook for yes-no-maybe vision
bradhilton Oct 17, 2025
585f903
feat: Implement MathVista training script for image-based question an…
bradhilton Oct 17, 2025
01d2358
refactor: Update tensor handling in DecoupledUnslothService and traje…
bradhilton Oct 17, 2025
fb745b6
Merge branch 'main' into feat/vlm-support
bradhilton Oct 22, 2025
fdd77eb
chore: Update dependencies and training notebook
bradhilton Oct 23, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading