Serve the home! Inference stack for your Nvidia DGX / RTX Spark (128GB ram) aka the Grace Blackwell AI supercomputer on your desk. Mostly vLLM based for now and single-spark. For the not-so-rich people. Updated once a month. Hobby project
docker docker-compose cuda inference self-hosted llama n1x arm64 model-serving mlops dgx generative-ai vllm local-llm gb10 nvidia-blackwell dgx-spark sm121 rtx-spark nfvp4
-
Updated
Oct 11, 2026 - JavaScript