Ramin Anushiravani
August 14th/2023
How to create your own GPT model from scratch on sub-reddits.
Almost all the implementations were inspired by Andrej karpathy Youtube Videos and his repo. https://github.com/karpathy/nanoGPT
You can find the main notebook that tackle this challenge here
Some text data utility is included here
Associated model artifacts and data processing steps are included here though some are not included due to their size.
Following notebooks where ran on 3.8.12. Please use the requierments to create a python environment for running the notebook.