## Benchmark Results - 2026-05-13 14:17:03 | Service | Total Time (s) | Tokens | Tokens/Sec | | :--- | :--- | :--- | :--- | | llamacpp-gemma | 4.04s | 690 | 170.61 | ## Benchmark Results (100 Prompts) - 2026-05-13 15:10:06 | Service | Avg Latency (s) | Total Tokens | Avg Tokens/Sec | Prompts | | :--- | :--- | :--- | :--- | :--- | | llamacpp-gemma | 11.83s | 180181 | 152.29 | 100 |