[bug] Conversion broken for diffusion models #320
Description
🐞 Describe the Bug
Huggingface converters are currently broken on main for dream, diffusion_llama and SSM. The conversion tests are currently disabled on main, and when re-enabling them we get the following errors:
FAILED tests/models/test_checkpoint.py::test_conversion[diffusion_llama]@dependency_group_3 - KeyError: "Missing required keys in `rope_scaling` for 'rope_type'='yarn': {'factor'}"
FAILED tests/models/test_checkpoint.py::test_huggingface_model[dream]@dependency_group_6 - ValueError: Comparison failed (1 errors)