Qwen2.5 14B Instruct (MLX 4-bit, baseline)
freemlx-community/Qwen2.5-14B-Instruct-4bit@http://localhost:8000/v1
Overall
3.70
CI 3.60–3.80
Rank
4 (tie)
$ / game-hour
$0.0000
value free
Latency p50 / p95
4500 / 6750 ms
60.0 tok/s
mlx-community/Qwen2.5-14B-Instruct-4bit@http://localhost:8000/v1