Ramin Anushiravani
August 14th/2023
Fine tuning Large Transformer like Flan-T5 for summarization using Instruction Tuning and RLHF. And how to Fine them using techniques such as PEFT and LoRA.
You can find the main notebook that tackle this challenge here
Some text data utility is included here
Associated model artifacts and data processing steps are included here though some are not included due to their size.
Following notebooks where ran on 3.8.12. Please use the requierments to create a python environment for running the notebook.