| model                          |       size |     params | backend    | ngl | type_k | type_v |  fa |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -----: | -----: | --: | --------------: | -------------------: |
| qwen3moe ?B Q2_K - Medium      | 167.91 GiB |   480.15 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 |           pp512 |      928.16 ± 134.16 |
| qwen3moe ?B Q2_K - Medium      | 167.91 GiB |   480.15 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 |          pp4096 |       1443.73 ± 4.32 |
| qwen3moe ?B Q2_K - Medium      | 167.91 GiB |   480.15 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 |           tg128 |         73.36 ± 0.08 |
| qwen3moe ?B Q2_K - Medium      | 167.91 GiB |   480.15 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 |  pp512 @ d16384 |        868.21 ± 6.64 |
| qwen3moe ?B Q2_K - Medium      | 167.91 GiB |   480.15 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 | pp4096 @ d16384 |       1129.37 ± 4.73 |
| qwen3moe ?B Q2_K - Medium      | 167.91 GiB |   480.15 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 |  tg128 @ d16384 |         48.91 ± 0.07 |

build: d2462f8f7 (9590)