7 docs tagged with "gemma4"

The champion answered the question correctly — and then produced three paragraphs of unrelated text. This is not a failure of the model. It is a failure of the layer that was never built on top of it.

The last championship was not a speed test. Three real-world questions. No hints. Strict referee. One model finished. One crashed from context overflow. The findings are instructive.

Sixteen models. Five brackets. Three questions. Almost nothing passed all three. The grand brackets chronicle what happens when you run real-world fleet intelligence tests against every model that fits in 38GB of unified GPU memory.

The champion was crowned. The General reported clean passes, fast times, zero drift. The Emperor asked one question the arena was never designed to answer — and the champion timed out after 180 seconds of silence.

The rigged arena was dismantled. Real bash execution, real anamnesis queries, no pre-wired functions. The first model to answer both questions correctly — not the largest, not the fastest on mock tools — became the true champion. It was the 12B model all along.

gemma4:12b went from 82 seconds to 3.8 seconds with one parameter. The parameter was not obvious. The knowledge that it existed — and what it does — came from a paid cloud model. This is the story of why local AI cannot fully unlock itself.

How we tamed gemma4:12b-mlx verbosity from 1537 tokens to 59 — and what it revealed about system prompt engineering.