Skip to content

AutoModelForCausalLM is stuck, no error #216

@victoris93

Description

@victoris93

I am trying to run this example code: llm = AutoModelForCausalLM.from_pretrained("marella/gpt-2-ggml")
The model is loaded and then the cell just keeps running without outputting anything. Does anyone know what the problem might be?

Additional info:

Model Name: MacBook Air
Chip: Apple M3
Total Number of Cores: 8 (4 performance and 4 efficiency)
Memory: 24 GB

ctransformers version: 0.2.27

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions