Skip to content

raminAudio/Instruction-Tuning-LLM

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Fine-Tuning Transformer with Instructions

Ramin Anushiravani

August 14th/2023

What?

Fine tuning Large Transformer like Flan-T5 for summarization using Instruction Tuning and RLHF. And how to Fine them using techniques such as PEFT and LoRA.

Where?

You can find the main notebook that tackle this challenge here

Some text data utility is included here

Associated model artifacts and data processing steps are included here though some are not included due to their size.

Following notebooks where ran on 3.8.12. Please use the requierments to create a python environment for running the notebook.

About

Instruction tuning big LLMs using PEFT

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published