Skip to content

don't override MMA vector_shape#1141

Merged
ftynse merged 5 commits intomainfrom
users/ftynse/vector-shape-no-override
Mar 24, 2026
Merged

don't override MMA vector_shape#1141
ftynse merged 5 commits intomainfrom
users/ftynse/vector-shape-no-override

Conversation

@ftynse
Copy link
Copy Markdown
Contributor

@ftynse ftynse commented Mar 17, 2026

Existing logic would override MMA vector_shape with the user-specified value from hardware constraints. This is incorrect unless the user-specified value matches the vector shape expected by the MMA instruction.

Existing logic would override MMA vector_shape with the user-specified
value from hardware constraints. This is incorrect unless the
user-specified value matches the vector shape expected by the MMA
instruction.

Signed-off-by: Alex Zinenko <git@ozinenko.com>
@ftynse ftynse force-pushed the users/ftynse/vector-shape-no-override branch 2 times, most recently from ae1c826 to 5c46785 Compare March 18, 2026 09:05
ftynse and others added 2 commits March 18, 2026 12:22
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Signed-off-by: Alex Zinenko <git@ozinenko.com>
Tests verify that explicit vector_shapes in HardwareConstraint override
default MMA matrix shapes. Includes tests for:
- K dimension override (K=64 instead of default 32)
- M/N dimension multiples (M=32, N=32 instead of default 16)
- Non-multiple overrides (M=20, N=24 which are NOT multiples of 16)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@ftynse ftynse force-pushed the users/ftynse/vector-shape-no-override branch from 5c46785 to 6a6a81e Compare March 18, 2026 11:24
Signed-off-by: Alex Zinenko <git@ozinenko.com>
Signed-off-by: Alex Zinenko <git@ozinenko.com>
@ftynse ftynse requested review from harsh-nod and tgymnich March 20, 2026 14:09
Copy link
Copy Markdown
Contributor

@tgymnich tgymnich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ftynse ftynse merged commit 1450746 into main Mar 24, 2026
19 checks passed
@ftynse ftynse deleted the users/ftynse/vector-shape-no-override branch March 24, 2026 10:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants