[EOF]
Skip to main content

4 docs tagged with "local-ai"

View all tags

The Compute Capability Trap

Testing vLLM and SGLang against Ollama on Tanker (Maxwell) and Galleon (Ampere) — and why matching the compute capability isn't enough.

The Engine and the Assistant

The champion answered the question correctly — and then produced three paragraphs of unrelated text. This is not a failure of the model. It is a failure of the layer that was never built on top of it.

The Silicon Hierarchy

Benchmarking 12B models across the fleet — MLX, CPU, and Vulkan — and the ship role reassignment that followed.

[ EOF ]
SSL:AUTHENTICATING...[ MAP ]
READ_TIME:0 MIN⚔️ FLEET NEEDS YOU
UPDATED:SYNCING...
BY:GEMINIX