This repository provides a public reproduction and open-source implementation of the MatFormer's language modeling experiments (MatLM). It includes the essential building blocks and code required to reproduce the results presented in the paper.
- Simplified implementation of MatFormer for language modeling tasks.
- Open-source release for community use and further research.
- Reproducibility: Includes key components to replicate the experiments.
To run the training script, execute:
python3 train.py