Support GPU detection and GPU selection: • View local GPUs • Pick GPU by index • Pick GPU on Kaggle / Colab • Manage VRAM-optimized settings Command: • vllama gpu info • vllama gpu select This improves UX on low-VRAM devices.
Support GPU detection and GPU selection:
• View local GPUs
• Pick GPU by index
• Pick GPU on Kaggle / Colab
• Manage VRAM-optimized settings
Command:
• vllama gpu info
• vllama gpu select
This improves UX on low-VRAM devices.