Pretrained models

[agenthong]

Hi, @lauraset !

Thanks for sharing this repo! There are two pretrained models in runs, which are named finetune.tar and V1.tar. How did you train these two models? Could you introduce respectively?

[lauraset]

Hi, @agenthong. The V1.tar is a compressed package which recorded the training loss (by tensorboardX), while fintune.tar is the model weights. Look predxx.py files.

[agenthong]

Hi, @agenthong. The V1.tar is a compressed package which recorded the training loss (by tensorboardX), while fintune.tar is the model weights. Look predxx.py files.

@lauraset Thanks for replying! I missed key(s) in state_dict when I loaded the finetune.tar in evaluate.py. The error is as following:

RuntimeError: Error(s) in loading state_dict for DataParallel:
        Missing key(s) in state_dict: "module.uencoder1.conv1.conv1.0.weight", "module.uencoder1.conv1.conv1.0.bias", "module.uencoder1.conv1.conv1.1.weight", "module.uencoder1.conv1.conv1.1.bias", "module.uencoder1.conv1.conv1.1.running_mean", "module.uencoder1.conv1.conv1.1.running_var", "module.uencoder1.conv1.conv2.0.weight", "module.uencoder1.conv1.conv2.0.bias", "module.uencoder1.conv1.conv2.1.weight", "module.uencoder1.conv1.conv2.1.bias", "module.uencoder1.conv1.conv2.1.running_mean", "module.uencoder1.conv1.conv2.1.running_var", "module.uencoder1.conv2.conv1.0.weight", "module.uencoder1.conv2.conv1.0.bias", "module.uencoder1.conv2.conv1.1.weight", "module.uencoder1.conv2.conv1.1.bias", "module.uencoder1.conv2.conv1.1.running_mean", "module.uencoder1.conv2.conv1.1.running_var", "module.uencoder1.conv2.conv2.0.weight", "module.uencoder1.conv2.conv2.0.bias", "module.uencoder1.conv2.conv2.1.weight", "module.uencoder1.conv2.conv2.1.bias", "module.uencoder1.conv2.conv2.1.running_mean", "module.uencoder1.conv2.conv2.1.running_var", "module.uencoder1.conv3.conv1.0.weight", "module.uencoder1.conv3.conv1.0.bias", "module.uencoder1.conv3.conv1.1.weight", "module.uencoder1.conv3.conv1.1.bias", "module.uencoder1.conv3.conv1.1.running_mean", "module.uencoder1.conv3.conv1.1.running_var", "module.uencoder1.conv3.conv2.0.weight", "module.uencoder1.conv3.conv2.0.bias", "module.uencoder1.conv3.conv2.1.weight", "module.uencoder1.conv3.conv2.1.bias", "module.uencoder1.conv3.conv2.1.running_mean", "module.uencoder1.conv3.conv2.1.running_var", "module.uencoder1.conv4.conv1.0.weight", "module.uencoder1.conv4.conv1.0.bias", "module.uencoder1.conv4.conv1.1.weight", "module.uencoder1.conv4.conv1.1.bias", "module.uencoder1.conv4.conv1.1.running_mean", "module.uencoder1.conv4.conv1.1.running_var", "module.uencoder1.conv4.conv2.0.weight", "module.uencoder1.conv4.conv2.0.bias", "module.uencoder1.conv4.conv2.1.weight", "module.uencoder1.conv4.conv2.1.bias", "module.uencoder1.conv4.conv2.1.running_mean", "module.uencoder1.conv4.conv2.1.running_var", "module.uencoder1.center.conv1.0.weight", "module.uencoder1.center.conv1.0.bias", "module.uencoder1.center.conv1.1.weight", "module.uencoder1.center.conv1.1.bias", "module.uencoder1.center.conv1.1.running_mean", "module.uencoder1.center.conv1.1.running_var", "module.uencoder1.center.conv2.0.weight", "module.uencoder1.center.conv2.0.bias", "module.uencoder1.center.conv2.1.weight", "module.uencoder1.center.conv2.1.bias", "module.uencoder1.center.conv2.1.running_mean", "module.uencoder1.center.conv2.1.running_var", "module.uencoder2.conv1.conv1.0.weight", "module.uencoder2.conv1.conv1.0.bias", "module.uencoder2.conv1.conv1.1.weight", "module.uencoder2.conv1.conv1.1.bias", "module.uencoder2.conv1.conv1.1.running_mean", "module.uencoder2.conv1.conv1.1.running_var", "module.uencoder2.conv1.conv2.0.weight", "module.uencoder2.conv1.conv2.0.bias", "module.uencoder2.conv1.conv2.1.weight", "module.uencoder2.conv1.conv2.1.bias", "module.uencoder2.conv1.conv2.1.running_mean", "module.uencoder2.conv1.conv2.1.running_var", "module.uencoder2.conv2.conv1.0.weight", "module.uencoder2.conv2.conv1.0.bias", "module.uencoder2.conv2.conv1.1.weight", "module.uencoder2.conv2.conv1.1.bias", "module.uencoder2.conv2.conv1.1.running_mean", "module.uencoder2.conv2.conv1.1.running_var", "module.uencoder2.conv2.conv2.0.weight", "module.uencoder2.conv2.conv2.0.bias", "module.uencoder2.conv2.conv2.1.weight", "module.uencoder2.conv2.conv2.1.bias", "module.uencoder2.conv2.conv2.1.running_mean", "module.uencoder2.conv2.conv2.1.running_var", "module.uencoder2.conv3.conv1.0.weight", "module.uencoder2.conv3.conv1.0.bias", "module.uencoder2.conv3.conv1.1.weight", "module.uencoder2.conv3.conv1.1.bias", "module.uencoder2.conv3.conv1.1.running_mean", "module.uencoder2.conv3.conv1.1.running_var", "module.uencoder2.conv3.conv2.0.weight", "module.uencoder2.conv3.conv2.0.bias", "module.uencoder2.conv3.conv2.1.weight", "module.uencoder2.conv3.conv2.1.bias", "module.uencoder2.conv3.conv2.1.running_mean", "module.uencoder2.conv3.conv2.1.running_var", "module.uencoder2.conv4.conv1.0.weight", "module.uencoder2.conv4.conv1.0.bias", "module.uencoder2.conv4.conv1.1.weight", "module.uencoder2.conv4.conv1.1.bias", "module.uencoder2.conv4.conv1.1.running_mean", "module.uencoder2.conv4.conv1.1.running_var", "module.uencoder2.conv4.conv2.0.weight", "module.uencoder2.conv4.conv2.0.bias", "module.uencoder2.conv4.conv2.1.weight", "module.uencoder2.conv4.conv2.1.bias", "module.uencoder2.conv4.conv2.1.running_mean", "module.uencoder2.conv4.conv2.1.running_var", "module.uencoder2.center.conv1.0.weight", "module.uencoder2.center.conv1.0.bias", "module.uencoder2.center.conv1.1.weight", "module.uencoder2.center.conv1.1.bias", "module.uencoder2.center.conv1.1.running_mean", "module.uencoder2.center.conv1.1.running_var", "module.uencoder2.center.conv2.0.weight", "module.uencoder2.center.conv2.0.bias", "module.uencoder2.center.conv2.1.weight", "module.uencoder2.center.conv2.1.bias", "module.uencoder2.center.conv2.1.running_mean", "module.uencoder2.center.conv2.1.running_var", "module.udecoder1.up_concat4.conv.conv1.0.weight", "module.udecoder1.up_concat4.conv.conv1.0.bias", "module.udecoder1.up_concat4.conv.conv2.0.weight", "module.udecoder1.up_concat4.conv.conv2.0.bias", "module.udecoder1.up_concat4.up.weight", "module.udecoder1.up_concat4.up.bias", "module.udecoder1.up_concat3.conv.conv1.0.weight", "module.udecoder1.up_concat3.conv.conv1.0.bias", "module.udecoder1.up_concat3.conv.conv2.0.weight", "module.udecoder1.up_concat3.conv.conv2.0.bias", "module.udecoder1.up_concat3.up.weight", "module.udecoder1.up_concat3.up.bias", "module.udecoder1.up_concat2.conv.conv1.0.weight", "module.udecoder1.up_concat2.conv.conv1.0.bias", "module.udecoder1.up_concat2.conv.conv2.0.weight", "module.udecoder1.up_concat2.conv.conv2.0.bias", "module.udecoder1.up_concat2.up.weight", "module.udecoder1.up_concat2.up.bias", "module.udecoder1.up_concat1.conv.conv1.0.weight", "module.udecoder1.up_concat1.conv.conv1.0.bias", "module.udecoder1.up_concat1.conv.conv2.0.weight", "module.udecoder1.up_concat1.conv.conv2.0.bias", "module.udecoder1.up_concat1.up.weight", "module.udecoder1.up_concat1.up.bias", "module.udecoder1.final.weight", "module.udecoder1.final.bias", "module.udecoder2.up_concat4.conv.conv1.0.weight", "module.udecoder2.up_concat4.conv.conv1.0.bias", "module.udecoder2.up_concat4.conv.conv2.0.weight", "module.udecoder2.up_concat4.conv.conv2.0.bias", "module.udecoder2.up_concat4.up.weight", "module.udecoder2.up_concat4.up.bias", "module.udecoder2.up_concat3.conv.conv1.0.weight", "module.udecoder2.up_concat3.conv.conv1.0.bias", "module.udecoder2.up_concat3.conv.conv2.0.weight", "module.udecoder2.up_concat3.conv.conv2.0.bias", "module.udecoder2.up_concat3.up.weight", "module.udecoder2.up_concat3.up.bias", "module.udecoder2.up_concat2.conv.conv1.0.weight", "module.udecoder2.up_concat2.conv.conv1.0.bias", "module.udecoder2.up_concat2.conv.conv2.0.weight", "module.udecoder2.up_concat2.conv.conv2.0.bias", "module.udecoder2.up_concat2.up.weight", "module.udecoder2.up_concat2.up.bias", "module.udecoder2.up_concat1.conv.conv1.0.weight", "module.udecoder2.up_concat1.conv.conv1.0.bias", "module.udecoder2.up_concat1.conv.conv2.0.weight", "module.udecoder2.up_concat1.conv.conv2.0.bias", "module.udecoder2.up_concat1.up.weight", "module.udecoder2.up_concat1.up.bias", "module.udecoder2.final.weight", "module.udecoder2.final.bias", "module.udecoder3.up_concat4.conv.conv1.0.weight", "module.udecoder3.up_concat4.conv.conv1.0.bias", "module.udecoder3.up_concat4.conv.conv2.0.weight", "module.udecoder3.up_concat4.conv.conv2.0.bias", "module.udecoder3.up_concat4.up.weight", "module.udecoder3.up_concat4.up.bias", "module.udecoder3.up_concat3.conv.conv1.0.weight", "module.udecoder3.up_concat3.conv.conv1.0.bias", "module.udecoder3.up_concat3.conv.conv2.0.weight", "module.udecoder3.up_concat3.conv.conv2.0.bias", "module.udecoder3.up_concat3.up.weight", "module.udecoder3.up_concat3.up.bias", "module.udecoder3.up_concat2.conv.conv1.0.weight", "module.udecoder3.up_concat2.conv.conv1.0.bias", "module.udecoder3.up_concat2.conv.conv2.0.weight", "module.udecoder3.up_concat2.conv.conv2.0.bias", "module.udecoder3.up_concat2.up.weight", "module.udecoder3.up_concat2.up.bias", "module.udecoder3.up_concat1.conv.conv1.0.weight", "module.udecoder3.up_concat1.conv.conv1.0.bias", "module.udecoder3.up_concat1.conv.conv2.0.weight", "module.udecoder3.up_concat1.conv.conv2.0.bias", "module.udecoder3.up_concat1.up.weight", "module.udecoder3.up_concat1.up.bias", "module.udecoder3.final.weight", "module.udecoder3.final.bias", "module.final.weight", "module.final.bias". 
        Unexpected key(s) in state_dict: "uencoder1.conv1.conv1.0.weight", "uencoder1.conv1.conv1.0.bias", "uencoder1.conv1.conv1.1.weight", "uencoder1.conv1.conv1.1.bias", "uencoder1.conv1.conv1.1.running_mean", "uencoder1.conv1.conv1.1.running_var", "uencoder1.conv1.conv1.1.num_batches_tracked", "uencoder1.conv1.conv2.0.weight", "uencoder1.conv1.conv2.0.bias", "uencoder1.conv1.conv2.1.weight", "uencoder1.conv1.conv2.1.bias", "uencoder1.conv1.conv2.1.running_mean", "uencoder1.conv1.conv2.1.running_var", "uencoder1.conv1.conv2.1.num_batches_tracked", "uencoder1.conv2.conv1.0.weight", "uencoder1.conv2.conv1.0.bias", "uencoder1.conv2.conv1.1.weight", "uencoder1.conv2.conv1.1.bias", "uencoder1.conv2.conv1.1.running_mean", "uencoder1.conv2.conv1.1.running_var", "uencoder1.conv2.conv1.1.num_batches_tracked", "uencoder1.conv2.conv2.0.weight", "uencoder1.conv2.conv2.0.bias", "uencoder1.conv2.conv2.1.weight", "uencoder1.conv2.conv2.1.bias", "uencoder1.conv2.conv2.1.running_mean", "uencoder1.conv2.conv2.1.running_var", "uencoder1.conv2.conv2.1.num_batches_tracked", "uencoder1.conv3.conv1.0.weight", "uencoder1.conv3.conv1.0.bias", "uencoder1.conv3.conv1.1.weight", "uencoder1.conv3.conv1.1.bias", "uencoder1.conv3.conv1.1.running_mean", "uencoder1.conv3.conv1.1.running_var", "uencoder1.conv3.conv1.1.num_batches_tracked", "uencoder1.conv3.conv2.0.weight", "uencoder1.conv3.conv2.0.bias", "uencoder1.conv3.conv2.1.weight", "uencoder1.conv3.conv2.1.bias", "uencoder1.conv3.conv2.1.running_mean", "uencoder1.conv3.conv2.1.running_var", "uencoder1.conv3.conv2.1.num_batches_tracked", "uencoder1.conv4.conv1.0.weight", "uencoder1.conv4.conv1.0.bias", "uencoder1.conv4.conv1.1.weight", "uencoder1.conv4.conv1.1.bias", "uencoder1.conv4.conv1.1.running_mean", "uencoder1.conv4.conv1.1.running_var", "uencoder1.conv4.conv1.1.num_batches_tracked", "uencoder1.conv4.conv2.0.weight", "uencoder1.conv4.conv2.0.bias", "uencoder1.conv4.conv2.1.weight", "uencoder1.conv4.conv2.1.bias", "uencoder1.conv4.conv2.1.running_mean", "uencoder1.conv4.conv2.1.running_var", "uencoder1.conv4.conv2.1.num_batches_tracked", "uencoder1.center.conv1.0.weight", "uencoder1.center.conv1.0.bias", "uencoder1.center.conv1.1.weight", "uencoder1.center.conv1.1.bias", "uencoder1.center.conv1.1.running_mean", "uencoder1.center.conv1.1.running_var", "uencoder1.center.conv1.1.num_batches_tracked", "uencoder1.center.conv2.0.weight", "uencoder1.center.conv2.0.bias", "uencoder1.center.conv2.1.weight", "uencoder1.center.conv2.1.bias", "uencoder1.center.conv2.1.running_mean", "uencoder1.center.conv2.1.running_var", "uencoder1.center.conv2.1.num_batches_tracked", "uencoder2.conv1.conv1.0.weight", "uencoder2.conv1.conv1.0.bias", "uencoder2.conv1.conv1.1.weight", "uencoder2.conv1.conv1.1.bias", "uencoder2.conv1.conv1.1.running_mean", "uencoder2.conv1.conv1.1.running_var", "uencoder2.conv1.conv1.1.num_batches_tracked", "uencoder2.conv1.conv2.0.weight", "uencoder2.conv1.conv2.0.bias", "uencoder2.conv1.conv2.1.weight", "uencoder2.conv1.conv2.1.bias", "uencoder2.conv1.conv2.1.running_mean", "uencoder2.conv1.conv2.1.running_var", "uencoder2.conv1.conv2.1.num_batches_tracked", "uencoder2.conv2.conv1.0.weight", "uencoder2.conv2.conv1.0.bias", "uencoder2.conv2.conv1.1.weight", "uencoder2.conv2.conv1.1.bias", "uencoder2.conv2.conv1.1.running_mean", "uencoder2.conv2.conv1.1.running_var", "uencoder2.conv2.conv1.1.num_batches_tracked", "uencoder2.conv2.conv2.0.weight", "uencoder2.conv2.conv2.0.bias", "uencoder2.conv2.conv2.1.weight", "uencoder2.conv2.conv2.1.bias", "uencoder2.conv2.conv2.1.running_mean", "uencoder2.conv2.conv2.1.running_var", "uencoder2.conv2.conv2.1.num_batches_tracked", "uencoder2.conv3.conv1.0.weight", "uencoder2.conv3.conv1.0.bias", "uencoder2.conv3.conv1.1.weight", "uencoder2.conv3.conv1.1.bias", "uencoder2.conv3.conv1.1.running_mean", "uencoder2.conv3.conv1.1.running_var", "uencoder2.conv3.conv1.1.num_batches_tracked", "uencoder2.conv3.conv2.0.weight", "uencoder2.conv3.conv2.0.bias", "uencoder2.conv3.conv2.1.weight", "uencoder2.conv3.conv2.1.bias", "uencoder2.conv3.conv2.1.running_mean", "uencoder2.conv3.conv2.1.running_var", "uencoder2.conv3.conv2.1.num_batches_tracked", "uencoder2.conv4.conv1.0.weight", "uencoder2.conv4.conv1.0.bias", "uencoder2.conv4.conv1.1.weight", "uencoder2.conv4.conv1.1.bias", "uencoder2.conv4.conv1.1.running_mean", "uencoder2.conv4.conv1.1.running_var", "uencoder2.conv4.conv1.1.num_batches_tracked", "uencoder2.conv4.conv2.0.weight", "uencoder2.conv4.conv2.0.bias", "uencoder2.conv4.conv2.1.weight", "uencoder2.conv4.conv2.1.bias", "uencoder2.conv4.conv2.1.running_mean", "uencoder2.conv4.conv2.1.running_var", "uencoder2.conv4.conv2.1.num_batches_tracked", "uencoder2.center.conv1.0.weight", "uencoder2.center.conv1.0.bias", "uencoder2.center.conv1.1.weight", "uencoder2.center.conv1.1.bias", "uencoder2.center.conv1.1.running_mean", "uencoder2.center.conv1.1.running_var", "uencoder2.center.conv1.1.num_batches_tracked", "uencoder2.center.conv2.0.weight", "uencoder2.center.conv2.0.bias", "uencoder2.center.conv2.1.weight", "uencoder2.center.conv2.1.bias", "uencoder2.center.conv2.1.running_mean", "uencoder2.center.conv2.1.running_var", "uencoder2.center.conv2.1.num_batches_tracked", "udecoder1.up_concat4.conv.conv1.0.weight", "udecoder1.up_concat4.conv.conv1.0.bias", "udecoder1.up_concat4.conv.conv2.0.weight", "udecoder1.up_concat4.conv.conv2.0.bias", "udecoder1.up_concat4.up.weight", "udecoder1.up_concat4.up.bias", "udecoder1.up_concat3.conv.conv1.0.weight", "udecoder1.up_concat3.conv.conv1.0.bias", "udecoder1.up_concat3.conv.conv2.0.weight", "udecoder1.up_concat3.conv.conv2.0.bias", "udecoder1.up_concat3.up.weight", "udecoder1.up_concat3.up.bias", "udecoder1.up_concat2.conv.conv1.0.weight", "udecoder1.up_concat2.conv.conv1.0.bias", "udecoder1.up_concat2.conv.conv2.0.weight", "udecoder1.up_concat2.conv.conv2.0.bias", "udecoder1.up_concat2.up.weight", "udecoder1.up_concat2.up.bias", "udecoder1.up_concat1.conv.conv1.0.weight", "udecoder1.up_concat1.conv.conv1.0.bias", "udecoder1.up_concat1.conv.conv2.0.weight", "udecoder1.up_concat1.conv.conv2.0.bias", "udecoder1.up_concat1.up.weight", "udecoder1.up_concat1.up.bias", "udecoder1.final.weight", "udecoder1.final.bias", "udecoder2.up_concat4.conv.conv1.0.weight", "udecoder2.up_concat4.conv.conv1.0.bias", "udecoder2.up_concat4.conv.conv2.0.weight", "udecoder2.up_concat4.conv.conv2.0.bias", "udecoder2.up_concat4.up.weight", "udecoder2.up_concat4.up.bias", "udecoder2.up_concat3.conv.conv1.0.weight", "udecoder2.up_concat3.conv.conv1.0.bias", "udecoder2.up_concat3.conv.conv2.0.weight", "udecoder2.up_concat3.conv.conv2.0.bias", "udecoder2.up_concat3.up.weight", "udecoder2.up_concat3.up.bias", "udecoder2.up_concat2.conv.conv1.0.weight", "udecoder2.up_concat2.conv.conv1.0.bias", "udecoder2.up_concat2.conv.conv2.0.weight", "udecoder2.up_concat2.conv.conv2.0.bias", "udecoder2.up_concat2.up.weight", "udecoder2.up_concat2.up.bias", "udecoder2.up_concat1.conv.conv1.0.weight", "udecoder2.up_concat1.conv.conv1.0.bias", "udecoder2.up_concat1.conv.conv2.0.weight", "udecoder2.up_concat1.conv.conv2.0.bias", "udecoder2.up_concat1.up.weight", "udecoder2.up_concat1.up.bias", "udecoder2.final.weight", "udecoder2.final.bias", "udecoder3.up_concat4.conv.conv1.0.weight", "udecoder3.up_concat4.conv.conv1.0.bias", "udecoder3.up_concat4.conv.conv2.0.weight", "udecoder3.up_concat4.conv.conv2.0.bias", "udecoder3.up_concat4.up.weight", "udecoder3.up_concat4.up.bias", "udecoder3.up_concat3.conv.conv1.0.weight", "udecoder3.up_concat3.conv.conv1.0.bias", "udecoder3.up_concat3.conv.conv2.0.weight", "udecoder3.up_concat3.conv.conv2.0.bias", "udecoder3.up_concat3.up.weight", "udecoder3.up_concat3.up.bias", "udecoder3.up_concat2.conv.conv1.0.weight", "udecoder3.up_concat2.conv.conv1.0.bias", "udecoder3.up_concat2.conv.conv2.0.weight", "udecoder3.up_concat2.conv.conv2.0.bias", "udecoder3.up_concat2.up.weight", "udecoder3.up_concat2.up.bias", "udecoder3.up_concat1.conv.conv1.0.weight", "udecoder3.up_concat1.conv.conv1.0.bias", "udecoder3.up_concat1.conv.conv2.0.weight", "udecoder3.up_concat1.conv.conv2.0.bias", "udecoder3.up_concat1.up.weight", "udecoder3.up_concat1.up.bias", "udecoder3.final.weight", "udecoder3.final.bias", "final.weight", "final.bias".

It looks like the model structure is different.