tokenizer是否是BloomTokenizerFast #5

Open

opened

在加载tokenizer的时候，报错autotokenizer没有BloomTokenizer，是否需要在tokenizer_config.json中修改成BloomTokenizerFast

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests