- In week 7 we implmented the full transformer, but it was actually just the gpt2 model - In this notebook we load the gpt2 model weights into the full transformer and see how it preforms