Skip to content

feat: add FixedLengthPreTokenizer for fixed-length tokenization #8

feat: add FixedLengthPreTokenizer for fixed-length tokenization

feat: add FixedLengthPreTokenizer for fixed-length tokenization #8

Triggered via pull request February 6, 2026 08:39
Status Success
Total duration 1m 38s
Artifacts

tests.yml

on: pull_request
Matrix: test
Fit to window
Zoom out
Zoom in