Skip to content

Commit ce3d583

Browse files
authored
Update README.md
1 parent 7ecb48c commit ce3d583

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ sudo docker run --gpus all --shm-size=128g -v ${PWD}:/workspace speedrun_plm \
2929

3030
## Overview
3131

32-
This project aims to democratize protein language model (pLM) training by reducing costs from $10,000-1,000,000 to $10-100 through modern NLP techniques. We have successfully reproduced ESMC-300M and ESMC-650M performance with fewer parameters and dramatically reduced costs. The project features significant improvements to the vanilla transformer architecture and is planning virtual competitions to drive innovation.
32+
This project aims to democratize protein language model (pLM) training by reducing costs from $10,000-1,000,000 to $10-100 through modern NLP techniques. We have successfully reproduced the language modeling loss of ESMC-300M and ESMC-650M with fewer parameters and dramatically reduced costs.
3333

3434
## Table of Contents
3535

0 commit comments

Comments
 (0)