Native Transformers interface

[Hrovatin]

Currently, the model and tokenizer rely on custom classes that do not match the usual transformers interface and require a separate code download and installation besides simply loading the weights from Hugging Face, which makes it harder to integrate into existing workflows.

Do you by any chance plan to make the interface more standard?

I think this could be easily achieved as it was for example in this rewrite of ESM-C model: https://huggingface.co/Synthyra/ESMplusplus_small/tree/main

[Hrovatin]

May be possible to close as it seems Synthyra added an implementation: https://github.com/Synthyra/FastPLMs/tree/main/e1_fastplms