python main.py experiment=task/$task data=Cls/$dataset data="{batch_size:$batch_size,num_workers:$num_workers}"
model=$model model.model_cfg.backbone.pretrained=$pretrained_path
train="{epochs:$epochs, accumulation_steps:1}" L="{devices:$devices}" tag=USFM
I think you should change to:
python main.py experiment=task/$task data=Cls/$dataset data="{batch_size:$batch_size,num_workers:$num_workers}"
model=$model model.model_cfg.pretrained=$pretrained_path
train="{epochs:$epochs, accumulation_steps:1}" L="{devices:$devices}" tag=USFM
I have another question: Whether the pretrained weight could be used for CLS.
python main.py experiment=task/$task data=Cls/$dataset data="{batch_size:$batch_size,num_workers:$num_workers}"
model=$model model.model_cfg.backbone.pretrained=$pretrained_path
train="{epochs:$epochs, accumulation_steps:1}" L="{devices:$devices}" tag=USFM
I think you should change to:
python main.py experiment=task/$task data=Cls/$dataset data="{batch_size:$batch_size,num_workers:$num_workers}"
model=$model model.model_cfg.pretrained=$pretrained_path
train="{epochs:$epochs, accumulation_steps:1}" L="{devices:$devices}" tag=USFM
I have another question: Whether the pretrained weight could be used for CLS.