5 docs tagged with "amd"

Era VIII (M74): The fleet learned the hard way that the right tool and the right hardware are not the same thing. Ollama. ROCm. GTT. Vulkan. The Cogitator speaks its truth.

How using Claude as an AI orchestrator exposed the full depth of AMD ROCm's hardware gaps — and why investing in remote AI intelligence today is the surest path to running sovereign local models tomorrow.

With Ollama disabled and GTT freed, the fleet reran the entire playoff under Vulkan RADV. qwen2.5:14b Q2 dropped from 113 seconds to 21 seconds. No language drift. gemma4:12b Q2 dropped from 93 seconds to 30 seconds. The hardware had been capable the whole time. The backend had not.

The fleet began a model competition with clean assumptions — Ollama, AMD GPU, two test questions. Within hours everything looked broken. Thai text in English responses. 113-second timeouts. A KDE crash. The hardware was fine. The setup was not.

The fleet investigated why large models were timing out and why Q2 produced Thai text. The answer was not in the models. It was in the physics of the machine — an iGPU, unified memory, and two inference servers fighting over the same 34GB pool.