Skip to content

Adaptation to other data types, e.g. bf16 or fp8 #2

@qijiaxing

Description

@qijiaxing

thanks for your intuitive blog and code!
I am thinking develop a kernel based on your kernel, but for LLM, bf16 or fp8 are mostly used.
Can you share some hints on which places in your kernel needs to changed to make it work for other data type?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions