-
-
Notifications
You must be signed in to change notification settings - Fork 3.5k
Description
LocalAI version: localai/localai:latest-gpu-nvidia-cuda-13
Environment, CPU architecture, OS, and Version: Linux 6.12.54-Unraid #1 SMP PREEMPT_DYNAMIC Tue Oct 21 15:58:46 PDT 2025 x86_64 AMD Ryzen 7 7800X3D 8-Core Processor AuthenticAMD GNU/Linux
Describe the bug
Several backend index entries do not match the repository and will not install. For example, if you attempt to install ace-step from Backend Management in the UI, it fails. See logs below. It tries to install a tag such as latest-gpu-nvidia-cuda-13-ace-step from the repo, but it only has a master (development) tag: master-gpu-nvidia-cuda-13-ace-step.
To Reproduce
- Menu > Settings > Backends
- Search for a mismatched index backend entry such as ace-step.
- Click the Install button.
- It will fail with an error message. See logs below.
Expected behavior
All entries in the backend index should correspond with entries that exist in the repo so they can be installed successfully. https://quay.io/repository/go-skynet/local-ai-backends?tab=tags&tag=latest
Logs
UI error message example: Error installing backend "ace-step": not a valid backend: run file not found "/backends/cuda13-ace-step/run.sh"
Log error message example:
Feb 06 10:47:51 ERROR Run file not found runFile="/backends/cuda13-whisperx/run.sh"
Feb 06 10:47:51 ERROR Error running the application error=error installing backend cuda13-whisperx: not a valid backend: run file not found "/backends/cuda13-whisperx/run.sh"
Additional context
I put together a spreadsheet comparing the backend index and repo.
The "Index" worksheet is filtered on entries that have no repo entry that matches exactly. The "Repo - Master Match" column indicates if a latest tag has a corresponding master/development tag. In some cases, neither exist (latest-gpu-hipblas-rfdetr and master-gpu-hipblas-rfdetr).
The "Repo All" worksheet is filtered on entries that have no index entry that matches exactly. Some of these are likely expected because they are old (e.g., cuda-11). Still, the list may be worth reviewing.
As a workaround, missing tags can be installed using "Install Backend Manually" and a path such as: oci://quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-ace-step