Thede Technologies

All postsTag

Benchmarks

Every post on the blog, one line each, and the Lab entry with this tag. The 2 entries tagged Benchmarks are lit. The blog’s newest post is in amber, and it does not carry the tag.

2026

  1. Lab

    Can a Local Model Read My Inbox? A Bake-off

    I gave three on-device models the same job - turn each email into a structured record - and judged them against Claude Opus. Three models, four runs, because Qwen ran once with thinking on and once with it off. With thinking off, the smallest-feeling model won on faithfulness, classification and speed.

  2. A general-purpose MoE multimodal beat every dedicated vision model on my father's handwriting

    I assumed a specialized vision model would win. I was wrong. A head-to-head on a hard handwriting corpus ended with the general-purpose MoE on top.