| model                          |       size |     params | backend    | ngl | type_k | type_v |  fa |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -----: | -----: | --: | --------------: | -------------------: |
| qwen3moe 235B.A22B Q4_K - Medium | 132.39 GiB |   235.09 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 |           pp512 |     1976.68 ± 254.95 |
| qwen3moe 235B.A22B Q4_K - Medium | 132.39 GiB |   235.09 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 |          pp4096 |      2613.35 ± 13.77 |
| qwen3moe 235B.A22B Q4_K - Medium | 132.39 GiB |   235.09 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 |           tg128 |         83.92 ± 0.12 |
| qwen3moe 235B.A22B Q4_K - Medium | 132.39 GiB |   235.09 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 |  pp512 @ d16384 |       1587.82 ± 6.95 |
| qwen3moe 235B.A22B Q4_K - Medium | 132.39 GiB |   235.09 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 | pp4096 @ d16384 |       1861.49 ± 4.90 |
| qwen3moe 235B.A22B Q4_K - Medium | 132.39 GiB |   235.09 B | CUDA       | 999 |   q8_0 |   q8_0 |   1 |  tg128 @ d16384 |         53.60 ± 0.05 |

build: d2462f8f7 (9590)