Skip to content

how to load model with device_map="auto" #35

@wac81

Description

@wac81

like this:
RetNetModelWithLMHead.from_pretrained(cp_lst[-1])
to:
RetNetModelWithLMHead.from_pretrained(cp_lst[-1], device_map="auto")

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions