12 docs tagged with "m74"

Era VIII (M74): The fleet learned the hard way that the right tool and the right hardware are not the same thing. Ollama. ROCm. GTT. Vulkan. The Cogitator speaks its truth.

The champion answered the question correctly — and then produced three paragraphs of unrelated text. This is not a failure of the model. It is a failure of the layer that was never built on top of it.

The last championship was not a speed test. Three real-world questions. No hints. Strict referee. One model finished. One crashed from context overflow. The findings are instructive.

Sixteen models. Five brackets. Three questions. Almost nothing passed all three. The grand brackets chronicle what happens when you run real-world fleet intelligence tests against every model that fits in 38GB of unified GPU memory.

Era VI — M72–M75. Era III and Era IV written and merged. The AIverse backlog clears. Gumroad guide takes shape. Warp Memory and Anamnesis principles give the fleet's inference layer a philosophical foundation.

The champion was crowned. The General reported clean passes, fast times, zero drift. The Emperor asked one question the arena was never designed to answer — and the champion timed out after 180 seconds of silence.

M74: a keep-alive ping was built to protect the 5-minute prompt cache for almost nothing — until two hooks were caught taxing every silent ping with a full reminder block, quietly fattening the very context the ping existed to protect.

The rigged arena was dismantled. Real bash execution, real anamnesis queries, no pre-wired functions. The first model to answer both questions correctly — not the largest, not the fastest on mock tools — became the true champion. It was the 12B model all along.

gemma4:12b went from 82 seconds to 3.8 seconds with one parameter. The parameter was not obvious. The knowledge that it existed — and what it does — came from a paid cloud model. This is the story of why local AI cannot fully unlock itself.

With Ollama disabled and GTT freed, the fleet reran the entire playoff under Vulkan RADV. qwen2.5:14b Q2 dropped from 113 seconds to 21 seconds. No language drift. gemma4:12b Q2 dropped from 93 seconds to 30 seconds. The hardware had been capable the whole time. The backend had not.

The fleet began a model competition with clean assumptions — Ollama, AMD GPU, two test questions. Within hours everything looked broken. Thai text in English responses. 113-second timeouts. A KDE crash. The hardware was fine. The setup was not.

The fleet investigated why large models were timing out and why Q2 produced Thai text. The answer was not in the models. It was in the physics of the machine — an iGPU, unified memory, and two inference servers fighting over the same 34GB pool.