Is DPO included in the current pipeline for training the model?

[HelloDuoLA]

I found the dpo_pipeline.sh file, but couldn't locate the place where it is called within the project's pipeline.

[Heterohabilis]

No. DPO is an independent pipeline. You can go to lpm_kernel/L2/dpo, and read the README there to know more info.