I am trying to run this example code: llm = AutoModelForCausalLM.from_pretrained("marella/gpt-2-ggml")
The model is loaded and then the cell just keeps running without outputting anything. Does anyone know what the problem might be?
Additional info:
Model Name: MacBook Air
Chip: Apple M3
Total Number of Cores: 8 (4 performance and 4 efficiency)
Memory: 24 GB
ctransformers version: 0.2.27