Benchmark: • Speed • Latency • Throughput • VRAM usage • Accuracy/performance Command: • vllama benchmark model_path This helps users compare architectures.
Benchmark:
• Speed
• Latency
• Throughput
• VRAM usage
• Accuracy/performance
Command:
• vllama benchmark model_path
This helps users compare architectures.