Multi-Task Training Needs 50 Days?

[ranery]

Hi, thanks for providing such an impressive codebase!

I am trying to train the multi-task model, it seems that 1k iterations cost around 30 hours, so if the total iteration is 40k, then the training time would be 40 x 30 / 24 = 50 days!!

Is that true on your side? Do you have any recipe to accelerate the training process?

Best regards,
Haoran