Error when running inference_mpMRI.py

[zhli12]

Hi,

Thanks for creating this repo!

When I tried to run

python inference_mpMRI.py \
    --ModelName ProViCNet \
    --vit_backbone dinov2_s_reg \
    --img_size 448 \
    --config_file ~/ProViCNet/configs/config_infer_MRI.yaml

I got an error that TypeError: unsupported operand type(s) for |: 'type' and 'NoneType'.

Based on the traceback message it seems to has something to do with the uploaded dinov2 model:

Traceback (most recent call last):
  File "inference_mpMRI.py", line 180, in <module>
    main(args)
  File "inference_mpMRI.py", line 58, in main
    model = GetModel(
  File "~/ProViCNet/ProViCNet/ModelArchitectures/Models.py", line 23, in GetModel
    MODEL = ProViCNet_contrastive(num_classes=nClass, backbone=vit_backbone, head='conv1')
  File "~/ProViCNet/ProViCNet/ModelArchitectures/ProViCNet/ProViCNet.py", line 644, in __init__
    self.backbone = load('facebookresearch/dinov2', self.backbones[backbone]['name'])
  File "~/.conda/envs/provicnet/lib/python3.8/site-packages/torch/hub.py", line 558, in load
    model = _load_local(repo_or_dir, model, *args, **kwargs)
  File "~/.conda/envs/provicnet/lib/python3.8/site-packages/torch/hub.py", line 587, in _load_local
    model = entry(*args, **kwargs)
  File "~/.cache/torch/hub/facebookresearch_dinov2_main/dinov2/hub/backbones.py", line 102, in dinov2_vits14_reg
    return _make_dinov2_model(
  File "~/.cache/torch/hub/facebookresearch_dinov2_main/dinov2/hub/backbones.py", line 33, in _make_dinov2_model
    from ..models import vision_transformer as vits
  File "~/.cache/torch/hub/facebookresearch_dinov2_main/dinov2/models/__init__.py", line 8, in <module>
    from . import vision_transformer as vits
  File "~/.cache/torch/hub/facebookresearch_dinov2_main/dinov2/models/vision_transformer.py", line 21, in <module>
    from dinov2.layers import Mlp, PatchEmbed, SwiGLUFFNFused, MemEffAttention, NestedTensorBlock as Block
  File "~/.cache/torch/hub/facebookresearch_dinov2_main/dinov2/layers/__init__.py", line 11, in <module>
    from .block import NestedTensorBlock, CausalAttentionBlock
  File "~/.cache/torch/hub/facebookresearch_dinov2_main/dinov2/layers/block.py", line 18, in <module>
    from .attention import Attention, MemEffAttention
  File "~/.cache/torch/hub/facebookresearch_dinov2_main/dinov2/layers/attention.py", line 36, in <module>
    class Attention(nn.Module):
  File "~/.cache/torch/hub/facebookresearch_dinov2_main/dinov2/layers/attention.py", line 58, in Attention
    self, init_attn_std: float | None = None, init_proj_std: float | None = None, factor: float = 1.0
TypeError: unsupported operand type(s) for |: 'type' and 'NoneType'

Please let me know if you have any recommendations on how to resolve the error. I've attached my python version and pacakge information below if that helps. Thank you!

Python Version and Packages

I installed the repo as decribed in the README.
My python version is 3.8.20 and all package information in the environment are listed below:

_libgcc_mutex 0.1 conda_forge conda-forge
_openmp_mutex 4.5 2_gnu conda-forge
albumentations 1.4.7 pypi_0 pypi
annotated-types 0.7.0 pypi_0 pypi
backcall 0.2.0 pyh9f0ad1d_0 conda-forge
brotli-python 1.1.0 py38h17151c0_1 conda-forge
bzip2 1.0.8 h4bc722e_7 conda-forge
ca-certificates 2025.8.3 hbd8a1cb_0 conda-forge
certifi 2022.12.7 pypi_0 pypi
cffi 1.17.0 py38heb5c249_0 conda-forge
charset-normalizer 2.1.1 pypi_0 pypi
cmake 3.25.0 pypi_0 pypi
decorator 4.4.2 py_0 conda-forge
einops 0.8.0 pypi_0 pypi
entrypoints 0.4 pyhd8ed1ab_0 conda-forge
filelock 3.13.1 pypi_0 pypi
h2 4.1.0 pyhd8ed1ab_0 conda-forge
hpack 4.0.0 pyh9f0ad1d_0 conda-forge
huggingface-hub 0.26.2 pypi_0 pypi
hyperframe 6.0.1 pyhd8ed1ab_0 conda-forge
icecream 2.1.3 pypi_0 pypi
idna 3.4 pypi_0 pypi
ipykernel 5.5.5 py38hd0cf306_0 conda-forge
ipython 7.33.0 py38h578d9bd_0 conda-forge
ipython_genutils 0.2.0 pyhd8ed1ab_1 conda-forge
jedi 0.18.2 pyhd8ed1ab_0 conda-forge
jinja2 3.1.4 pypi_0 pypi
joblib 1.4.2 pyhd8ed1ab_0 conda-forge
jupyter_client 7.4.9 pyhd8ed1ab_0 conda-forge
jupyter_core 5.8.1 pyh31011fe_0 conda-forge
keyutils 1.6.3 hb9d3cd8_0 conda-forge
krb5 1.21.3 h659f571_0 conda-forge
ld_impl_linux-64 2.44 h1423503_1 conda-forge
libblas 3.9.0 20_linux64_openblas conda-forge
libcblas 3.9.0 20_linux64_openblas conda-forge
libedit 3.1.20250104 pl5321h7949ede_0 conda-forge
libffi 3.4.6 h2dba641_1 conda-forge
libgcc 15.1.0 h767d61c_4 conda-forge
libgcc-ng 15.1.0 h69a702a_4 conda-forge
libgfortran 15.1.0 h69a702a_4 conda-forge
libgfortran-ng 15.1.0 h69a702a_4 conda-forge
libgfortran5 15.1.0 hcea5267_4 conda-forge
libgomp 15.1.0 h767d61c_4 conda-forge
liblapack 3.9.0 20_linux64_openblas conda-forge
liblzma 5.8.1 hb9d3cd8_2 conda-forge
liblzma-devel 5.8.1 hb9d3cd8_2 conda-forge
libnsl 2.0.1 hb9d3cd8_1 conda-forge
libopenblas 0.3.25 pthreads_h413a1c8_0 conda-forge
libsodium 1.0.18 h36c2ea0_1 conda-forge
libsqlite 3.50.4 h0c1763c_0 conda-forge
libstdcxx 15.1.0 h8f9b012_4 conda-forge
libstdcxx-ng 15.1.0 h4852527_4 conda-forge
libuuid 2.38.1 h0b41bf4_0 conda-forge
libxcrypt 4.4.36 hd590300_1 conda-forge
libzlib 1.3.1 hb9d3cd8_2 conda-forge
lit 15.0.7 pypi_0 pypi
llvmlite 0.41.1 pypi_0 pypi
markupsafe 2.1.5 pypi_0 pypi
matplotlib 3.7.5 pypi_0 pypi
matplotlib-inline 0.1.7 pyhd8ed1ab_0 conda-forge
monai 1.3.1 pypi_0 pypi
mpmath 1.3.0 pypi_0 pypi
ncurses 6.5 h2d0b736_3 conda-forge
nest-asyncio 1.6.0 pyhd8ed1ab_0 conda-forge
nibabel 5.1.0 pypi_0 pypi
numba 0.58.1 pypi_0 pypi
numpy 1.24.4 py38h59b608b_0 conda-forge
opencv-python 4.9.0.80 pypi_0 pypi
opencv-python-headless 4.12.0.88 pypi_0 pypi
openssl 3.5.2 h26f9b46_0 conda-forge
packaging 25.0 pyh29332c3_1 conda-forge
pandas 2.0.3 pypi_0 pypi
parso 0.8.4 pyhd8ed1ab_0 conda-forge
pexpect 4.9.0 pyhd8ed1ab_0 conda-forge
pickleshare 0.7.5 py_1003 conda-forge
pip 24.3.1 pyh8b19718_0 conda-forge
platformdirs 4.2.2 pyhd8ed1ab_0 conda-forge
pooch 1.8.2 pyhd8ed1ab_0 conda-forge
prompt-toolkit 3.0.43 pyha770c72_0 conda-forge
ptyprocess 0.7.0 pyhd3deb0d_0 conda-forge
pycparser 2.22 pyhd8ed1ab_0 conda-forge
pydantic 2.10.6 pypi_0 pypi
pydantic-core 2.27.2 pypi_0 pypi
pygments 2.19.2 pypi_0 pypi
pyparsing 3.1.4 pypi_0 pypi
pysocks 1.7.1 pyha2e5f31_6 conda-forge
python 3.8.20 h4a871b0_2_cpython conda-forge
python-dateutil 2.9.0.post0 pypi_0 pypi
python_abi 3.8 6_cp38 conda-forge
pyyaml 6.0.1 py38h01eb140_1 conda-forge
pyzmq 24.0.1 py38hfc09fa9_1 conda-forge
readline 8.2 h8c095d6_2 conda-forge
requests 2.28.1 pypi_0 pypi
safetensors 0.4.3 pypi_0 pypi
scikit-learn 1.3.2 py38ha25d942_2 conda-forge
scipy 1.10.1 py38h59b608b_3 conda-forge
setuptools 75.3.0 pyhd8ed1ab_0 conda-forge
simpleitk 2.3.1 pypi_0 pypi
six 1.17.0 pypi_0 pypi
sympy 1.13.3 pypi_0 pypi
threadpoolctl 3.5.0 pyhc1e730c_0 conda-forge
timm 1.0.3 pypi_0 pypi
tk 8.6.13 noxft_hd72426e_102 conda-forge
torch 2.0.0+cu117 pypi_0 pypi
torchvision 0.15.0+cu117 pypi_0 pypi
tornado 6.2 py38h0a891b7_1 conda-forge
tqdm 4.66.5 pypi_0 pypi
traitlets 5.14.3 pyhd8ed1ab_0 conda-forge
triton 2.0.0 pypi_0 pypi
typing-extensions 4.13.2 pypi_0 pypi
tzdata 2025.2 pypi_0 pypi
umap-learn 0.5.6 pypi_0 pypi
urllib3 1.26.13 pypi_0 pypi
wcwidth 0.2.13 pyhd8ed1ab_0 conda-forge
wheel 0.45.1 pyhd8ed1ab_0 conda-forge
xz 5.8.1 hbcc6ac9_2 conda-forge
xz-gpl-tools 5.8.1 hbcc6ac9_2 conda-forge
xz-tools 5.8.1 hb9d3cd8_2 conda-forge
yaml 0.2.5 h280c20c_3 conda-forge
zeromq 4.3.5 h75354e8_4 conda-forge
zstandard 0.23.0 py38h62bed22_0 conda-forge
zstd 1.5.6 ha6fb4c9_0 conda-forge