Cannot download DiffuLLama-gsm

[iloverdl]

Dear Team,
As I try to download the DiffuLLama-gsm model followed by the instruction

from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("llama2-ddm")
model = PeftModel.from_pretrained(base_model, "diffusionfamily/diffullama-gsm")

The error is

HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/llama2-ddm/resolve/main/config.json

The above exception was the direct cause of the following exception:

RepositoryNotFoundError                   Traceback (most recent call last)

OSError: llama2-ddm is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models'
If this is a private repository, make sure to pass a token having permission to this repo either by logging in with `huggingface-cli login` or by passing `token=<your_token>`

[summmeer]

Hi, since customized model architecture is not implemented in huggingface, so you can not load it using AutoModelForCausalLM.from_pretrained("llama2-ddm"). You can load the diffusion base model in the following way:

DiffuLLaMA/inf_diffugpt.py

Line 27 in 60abd1e

model = DiscreteDiffusionModel.from_pretrained(

For peft model, if from_pretrained is not working, you can still use LLaMaFactory code base to load it by providing adapter_name_or_path (see readme).