[merge] release new code#973

Merged

Alcanderian merged 35 commits intomasterfrom

20241107-merge-llm_v2

Nov 7, 2024

Commits on Nov 7, 2024

[deps] update llm.kernel.cuda top internal
Alcanderian
committed
[feature] update db.mhca kernel interface
Alcanderian
committed
[opt] optimize i8i8 fuse
Alcanderian
committed
[feature] enable i4f16 online quantize
Alcanderian
committed
[feature] add dep version variables

ouguoyu
authored and
Alcanderian
committed
[fix] do not override `PPLNN_DEP_PROTOBUF_VERSION` so that we can use the builtin *.pb.* files

ouguoyu
authored and
Alcanderian
committed
[deps] change ppl.llm.kernel.cuda to internal-master
Alcanderian
committed
[feature] add alibislope gen
Alcanderian
committed
[opt] update mhca interface
Alcanderian
committed
[feture] reserve old benchmark for compare
Alcanderian
committed
[refactor] update mhca api
Alcanderian
committed
[fix] don't call virtual function in destructor

ouguoyu
authored and
Alcanderian
committed
[feature] add decoding attn engine option
Alcanderian
committed
[feature][cuda]add vision embedding to llm.

Liheng Jian
authored and
Alcanderian
committed
[feature]add cudnn support in cmake/cmakelists.txt.

Liheng Jian
authored and
Alcanderian
committed
[opt]swith cudnn dependency to ppl.llm.kernel.cuda.

Liheng Jian
authored and
Alcanderian
committed
[feature][cuda]add vision embedding to llm.

Liheng Jian
authored and
Alcanderian
committed
[feature]add cudnn support in cmake/cmakelists.txt.

Liheng Jian
authored and
Alcanderian
committed
[opt]swith cudnn dependency to ppl.llm.kernel.cuda.

Liheng Jian
authored and
Alcanderian
committed
[opt]add cudnn&VisionEmbedding micro.

Liheng Jian
authored and
Alcanderian
committed
[fix] minor fix llm_cuda_device.h
Alcanderian
committed
[feature][cuda]add vision embedding to llm.

Liheng Jian
authored and
Alcanderian
committed
[feature]add cudnn support in cmake/cmakelists.txt.

Liheng Jian
authored and
Alcanderian
committed
[opt]swith cudnn dependency to ppl.llm.kernel.cuda.

Liheng Jian
authored and
Alcanderian
committed
[feature] suport fp8

chenjingmin
authored and
Alcanderian
committed
fix review comment

chenjingmin
authored and
Alcanderian
committed
[feature] support pixel unshuffle

yimmmin
authored and
Alcanderian
committed
[feature] support tensor parallel rms norm

yimmmin
authored and
Alcanderian
committed
[feature] support cache prefill attention

yimmmin
authored and
Alcanderian
committed
[fix] fix cache_prefill_flag val

yimmmin
authored and
Alcanderian
committed
[log] change cache prefill log to debug

shengyunrui
authored and
Alcanderian
committed
[release] llm_v2
Alcanderian
committed
[fix] fix deps
Alcanderian
committed
[fix] fix online_cast_kernel.h
Alcanderian
committed
[deps] update deps
Alcanderian
committed