>_ŁukaszGawenda
No video yet

Results

Models I ran through the same tests on the same RTX PRO 6000, that are not in a video yet. Each one's own results; the head-to-head comes with its video. How I test.

tested 2026-10-29

unsloth/DeepSeek-V4.1-Flash-1017-GGUF UD-IQ2_XXS

llama.cpp b11717-b72050d03 · UD-IQ2_XXS · run it yourself

PerformancePrefill, full window 430 s Decode about 31 tok/s at 2K context, no drafter. Part of the model runs from system RAM and the NVMe.
Tool useBFCL core 70.3 %
Context retentionRecall over the grid 27 / 27 100%
Battle arena no result No score: both runs hit the runner's 300-minute limit partway through the 15 gauntlet battles, at 40 to 65 minutes an answer.
Drawing no result Not scored yet: the facts in the drawing are not checked.
Voxel no result No final build: the session ended before it handed one in.
DesignHard rules 7 / 7
Rube GoldbergBall in the cup no
CAPTCHASolved 18 / 40 It ran with 20 minutes a puzzle; the score is taken at 7 minutes like every other model's. Within its own 20: 23 of 40.
Thinking tokenstotal over 5 tests 866,249
VRAM in usethe most in any test 94.4 GB
  • One run per test, at a 400 W GPU power cap, on llama.cpp built from ggml-org/llama.cpp#30817 (DeepSeek V4.1 support, not merged when tested): no published llama.cpp image loads it yet.

The graphs: speed, tool use, CAPTCHA and more →

tested 2026-10-17

ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF IQ3_S

llama.cpp b11552-23b0202a1 · IQ3_S · run it yourself

PerformancePrefill, full window 205 s
Tool useBFCL core 70.7 %
Context retentionRecall over the grid 27 / 27 100%
Battle arenaOpen arena score (1 blind army) 362 / 1000
DrawingFormat checks 8 / 8
Voxel no result No number: the castle is only judged by eye, against another model. Its build is on its own page, under What it made.
DesignHard rules 7 / 7
Rube GoldbergBall in the cup yes
CAPTCHASolved 19 / 40
Thinking tokenstotal over 6 tests 1,271,767
VRAM in usethe most in any test 33.2 GB
  • One run per test, at a 400 W GPU power cap.
  • The same Swift 1.5 weights as ukisai/Swift-1.5-Qwen3.8-27B-GGUF, in UkisAI's mixed-precision GSQ-RCO quant at IQ3_S, the repo's biggest tier.

The graphs: speed, tool use, CAPTCHA and more →