1. Bug fix. 2. add fast long retention implement#25

Open

veya2ztn wants to merge 2 commits intosyncdoth:mainfrom

Commits on Oct 16, 2023

1.Fix bug for the mode with inputs_embedding rather than inputs_ids. 2. Add fix length seq arguement when the inputs is (addtional_token, pask_kv) 3. add fast retention implement when the sequence…
veya2ztn
committed

Commits on Nov 3, 2023

better chunkwise retention
veya2ztn
committed