Skip to content

First version of SDPA Fwd - No need to review#548

Closed
cfgfung wants to merge 22 commits intointel:mainfrom
cfgfung:sdpa_fwd_upstream
Closed

First version of SDPA Fwd - No need to review#548
cfgfung wants to merge 22 commits intointel:mainfrom
cfgfung:sdpa_fwd_upstream

Conversation

@cfgfung
Copy link
Copy Markdown

@cfgfung cfgfung commented Oct 6, 2025

A repo for PyTorch SDPA Forward Upstreaming

Functionalities:

  • BF16/FP16
  • Both BSHD and BHSD layouts
  • Output LSE for training
  • Custom softmax scale
  • Bottom right masking (PyTorch specific) - Is_causal

@rolandschulz
Copy link
Copy Markdown

This should be based on #547

@cfgfung cfgfung force-pushed the sdpa_fwd_upstream branch from f99c157 to 2c56c1e Compare October 9, 2025 18:09
@cfgfung cfgfung changed the title First version of SDPA Fwd First version of SDPA Fwd - No need to review Oct 12, 2025
@cfgfung
Copy link
Copy Markdown
Author

cfgfung commented Oct 12, 2025

This should be based on #547

Hi Roland,

Thanks for the review. Right now it is more like for internal use and PyTorch Integration. Please skip the review for now.

@Antonyvance Antonyvance added the redesign required Implementation require a redesign label Oct 17, 2025
@tdeng5
Copy link
Copy Markdown

tdeng5 commented Mar 31, 2026

Close invalid PR.

We have refined SYCL-TLA architecture and APIs, this PR is out of date.
If you still need this PR, please resubmit a new one bases on the latest source code.

@tdeng5 tdeng5 closed this Mar 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

redesign required Implementation require a redesign

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants