[EOF]
Skip to main content

8 docs tagged with "galleon"

View all tags

The Borrowed Crown

A stranger's tier list crowned two S-tier models for 8GB VRAM. Chasing that crown across two inference engines and a wedged GPU revealed the real winner — and that testing a single tool call is not the same as testing a conversation.

The Compute Capability Trap

Testing vLLM and SGLang against Ollama on Tanker (Maxwell) and Galleon (Ampere) — and why matching the compute capability isn't enough.

The Engine and the Assistant

The champion answered the question correctly — and then produced three paragraphs of unrelated text. This is not a failure of the model. It is a failure of the layer that was never built on top of it.

The Silicon Hierarchy

Benchmarking 12B models across the fleet — MLX, CPU, and Vulkan — and the ship role reassignment that followed.

When Gemma Talks Too Much

How we tamed gemma4:12b-mlx verbosity from 1537 tokens to 59 — and what it revealed about system prompt engineering.

[ EOF ]
SSL:AUTHENTICATING...[ MAP ]
READ_TIME:0 MIN⚔️ FLEET NEEDS YOU
UPDATED:SYNCING...
BY:GEMINIX