Skip to content

Kernel Fusion #72

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
ejmeitz wants to merge 11 commits into
base: main
Choose a base branch
from
Draft

Kernel Fusion #72

ejmeitz wants to merge 11 commits into from

Conversation

@ejmeitz
Copy link
Member

@ejmeitz ejmeitz commented Oct 2, 2025

Goals:

  • Automatically fuse broadcast operations into a single CUDA kernel
  • Allow users to fuse custom functions which when called invoke a fused kernel

ejmeitz and others added 11 commits October 2, 2025 14:01
@ejmeitz
copy changes to fresh branch
dedc837
@ejmeitz
Update README.md
2d403e0
@krasow @ejmeitz
Update PTX generation (#62)
ac5d40e
@ejmeitz @krasow
Implement Broadcasting Interface (#65)
520edb1 
* init broadcasting changes

* broadasting almost works

* error on user defined functions

* support scalar broadcasting

* asd

* better type promotion

* fix floaty unary ops

* use optimized square and reciprocal calls given 2 and -1 literals

* start tests

* add allowscalar and allowdouble

* ban promotion to all wider types

* working on tests

* force NDArray type param for dim to be Int64

* tests up to GEMM pass

* up to unary_ops pass

* unary reductions pass tests

* binops pass except things with NaN

* all tests pass

* add short hands to copy to and from Julia array

* tests for scalars

* fix tests i broke

* stuff

* fix some things

* all tests pass

* remove if-else

* separate out promotion logic

* add lcm, gcd, negation tests

---------

Co-authored-by: krasow <krasow@u.northwestern.edu>
@krasow @ejmeitz
@cunumeric macro for scoping intermediate temporary allocations. (#68)
a4237b8
@krasow @ejmeitz
rm compile_wrapper.sh (#69)
c58c6c0
@krasow @ejmeitz
fix .random edge case (#70)
d1a9e72 
Co-authored-by: krasow <krasow@u.northwestern.edu>
@krasow @ejmeitz
remove .random and update rand (#71)
4690f22
@ejmeitz
working on fusion
a6163d5
@ejmeitz
general outline
5150406
@ejmeitz
asd
1c78d61
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@ejmeitz @krasow