Questions on guide GPT-3.5 #3
Description
Hello, I really admire the dedication and effort you put into your work. But I have few questions on the process when i was using the scripts to train GPT2XL and guide the decoding of GPT3.5.
First, what I want to know is how the checkpoint-best/pytorch_model.bin comes. Do you mean it comes from your training process or just from the original model? When I loaded the script of fine-tune RIPA on gpt2, it did not work at all and showed the weight missing.
Second, would you be so kind to provide the version of packages in requirements.txt ? That will help a lot.
I appreciate your time and assistance in clarifying these points.