Gemma 4 12B (GGUF, llama.cpp)
freeunsloth/gemma-4-12b-it-GGUF@http://localhost:8000/v1
Overall
3.68
CI 3.58–3.78
Rank
4 (tie)
$ / game-hour
$0.0000
value free
Latency p50 / p95
5500 / 8250 ms
60.0 tok/s
unsloth/gemma-4-12b-it-GGUF@http://localhost:8000/v1