THEDE TECHNOLOGIES
Revised 19 Nov 2026

Pay for it, sheet 09 of 13

Routing and model lifecycle

Sending each prompt to the right model, and surviving the deprecation clocks that retire the one you tuned for.

7Tools I checked
3Open gaps
Routing is a commodity, taste is notWhere the market is
11 Nov 2026Last checked
If you do one thing

List every prompt pinned to a model with a shutdown date, and schedule the golden-set run before the date, not after.

The toolkit as a map: 4 layers, 13 sheets, 112 tools drawn as filled squares and 46 open gaps drawn as hatched squares INDEX TO THE THIRTEEN SHEETS 112 tools, 46 open gaps, revised 19 Nov 2026 LAYER 1 TRUST THE OUTPUT Layer total 3 sheets 22 tools on the map 11 open gaps 01 Observability and evals promptfoo 1 promptfoo Langfuse 2 Langfuse Arize Phoenix 3 Arize Phoenix Braintrust 4 Braintrust DeepEval 5 DeepEval OpenTelemetry GenAI conventions 6 OTel GenAI Demystifying evals for AI agents 7 Evals guide OpenAI deprecations 8 OpenAI dates Judge calibration 9 Judge kappa Open gap a a Open gap b b Open gap c c Open gap d d 02 The door before the merge GitHub branch protection and CODEOWNERS 1 Branch rules GitHub Copilot code review 2 Copilot review Claude Code Review 3 Claude Review Greptile 4 Greptile CodeRabbit 5 CodeRabbit Socket Firewall 6 Socket Firewall GitHub Agentic Workflows 7 Agentic Workflows Open gap a a Open gap b b Open gap c c Open gap d d 03 Measuring the org DORA, State of AI-assisted Software Development 2025 1 DORA 2025 METR, early-2025 AI and experienced developers 2 METR study DX AI Measurement Framework 3 DX GitClear code quality research 4 GitClear Faros 5 Faros Multitudes 6 Multitudes Open gap a a Open gap b b Open gap c c LAYER 2 CONTAIN THE AGENT 4 sheets, 35 tools, 13 gaps 04 MCP gateways and registries MCP specification, 2026-07-28 1 MCP spec Official MCP Registry 2 MCP Registry Docker MCP Gateway 3 Docker Gateway Obot 4 Obot Microsoft MCP Gateway 5 Microsoft gateway Mintive 6 Mintive Kong AI Gateway 7 Kong Cloudflare MCP server portals 8 Cloudflare portals Amazon Bedrock AgentCore Gateway 9 AgentCore Gateway Open gap a a Open gap b b Open gap c c Open gap d d Open gap e e 05 Identity and secrets Okta Cross App Access 1 Cross App Access Auth0 Token Vault 2 Token Vault Microsoft Entra Agent ID 3 Entra Agent ID Aembit 4 Aembit Teleport 5 Teleport SPIFFE 6 SPIFFE Open gap a a Open gap b b 06 Shadow AI and ghost jobs Nudge Security 1 Nudge Harmonic Security 2 Harmonic Reco 3 Reco Microsoft Purview for AI 4 Purview Healthchecks.io 5 Health checks Cronitor 6 Cronitor Sentry Crons 7 Sentry Crons Open gap a a Open gap b b Open gap c c 07 Sandboxing and containment Claude Code sandbox 1 Claude Code sandbox Codex sandboxing 2 Codex nono 3 nono Docker Sandboxes 4 Docker Sandboxes E2B 5 E2B Hosted sandboxes 6 Hosted sandboxes Apple container 7 Apple container Anthropic Sandbox Runtime 8 Sandbox Runtime Agent hooks 9 Agent hooks Claude Code managed settings 10 Managed settings How we built Claude Code auto mode 11 Auto mode The lethal trifecta 12 Lethal trifecta OWASP LLM06: Excessive Agency 13 OWASP LLM06 Open gap a a Open gap b b Open gap c c LAYER 3 PAY FOR IT Layer total 2 sheets 13 tools on the map 7 open gaps 08 Spend governance Claude plans and pricing 1 Claude plans Claude Code cost controls 2 Claude Code costs GitHub budgets and alerts 3 GitHub budgets LiteLLM 4 LiteLLM Cloudflare AI Gateway 5 Cloudflare AI Gateway Vantage for Anthropic 6 Vantage Open gap a a Open gap b b Open gap c c Open gap d d 09 Routing and model lifecycle Anthropic model deprecations 1 Claude dates OpenRouter Auto Router 2 OpenRouter Auto Microsoft Foundry model router 3 Foundry router Amazon Bedrock intelligent prompt routing 4 Bedrock routing Not Diamond 5 Not Diamond Requesty 6 Requesty RouteLLM 7 RouteLLM Open gap a a Open gap b b Open gap c c LAYER 4 FEED IT, STAFF IT, SELL IT 4 sheets, 42 tools, 15 gaps 10 Context layer and memory Glean 1 Glean Onyx 2 Onyx Credal 3 Credal Dust 4 Dust msgvault 5 msgvault AGENTS.md 6 AGENTS .md Mem0 7 Mem0 Open gap a a Open gap b b Open gap c c Open gap d d Open gap e e 11 Hiring and verification Greenhouse Real Talent 1 Greenhouse Real Talent Pindrop 2 Pindrop Karat 3 Karat CoderPad 4 CoderPad Open gap a a Open gap b b 12 Discovery and selling first User Interviews 1 User Interviews Respondent 2 Respondent Boardy 3 Boardy Happenstance 4 Happen stance Clay 5 Clay Listen Labs 6 Listen Labs Synthetic Users 7 Synthetic Users Synthetic Users: If, When, and How to Use AI-Generated Research 8 NN/g article Open gap a a Open gap b b Open gap c c 13 Agent harnesses Claude Code 1 Claude Code OpenAI Codex 2 Codex Gemini CLI 3 Gemini CLI GitHub Copilot agents 4 Copilot agents Cursor 5 Cursor OpenCode 6 OpenCode Goose 7 Goose Cline 8 Cline Pi, and its fork omp 9 Pi Claude Agent SDK 10 Claude Agent SDK OpenAI Agents SDK 11 OpenAI Agents SDK Google Agent Development Kit 12 Google ADK Microsoft Agent Framework 13 Agent Framework Strands Agents 14 Strands LangGraph 15 LangGraph Effective harnesses for long-running agents 16 Harness guide Paradev, formerly Superset 17 Paradev Orca 18 Orca Herdr 19 Herdr Paseo 20 Paseo Symphony 21 Symphony Stripe Minions 22 Stripe Minions StrongDM's software factory 23 StrongDM factory Open gap a a Open gap b b Open gap c c Open gap d d Open gap e e The toolkit as a map: 4 layers, 13 sheets, 112 tools drawn as filled squares and 46 open gaps drawn as hatched squares INDEX TO THE THIRTEEN SHEETS 112 tools, 46 open gaps, revised 19 Nov 2026 LAYER 1 TRUST THE OUTPUT Layer total 3 sheets 22 tools on the map 11 open gaps 01 Observability and evals promptfoo 1 promptfoo Langfuse 2 Langfuse Arize Phoenix 3 Arize Phoenix Braintrust 4 Braintrust DeepEval 5 DeepEval OpenTelemetry GenAI conventions 6 OTel GenAI Demystifying evals for AI agents 7 Evals guide OpenAI deprecations 8 OpenAI dates Judge calibration 9 Judge kappa Open gap a a Open gap b b Open gap c c Open gap d d 02 The door before the merge GitHub branch protection and CODEOWNERS 1 Branch rules GitHub Copilot code review 2 Copilot review Claude Code Review 3 Claude Review Greptile 4 Greptile CodeRabbit 5 CodeRabbit Socket Firewall 6 Socket Firewall GitHub Agentic Workflows 7 Agentic Workflows Open gap a a Open gap b b Open gap c c Open gap d d 03 Measuring the org DORA, State of AI-assisted Software Development 2025 1 DORA 2025 METR, early-2025 AI and experienced developers 2 METR study DX AI Measurement Framework 3 DX GitClear code quality research 4 GitClear Faros 5 Faros Multitudes 6 Multitudes Open gap a a Open gap b b Open gap c c LAYER 2 CONTAIN THE AGENT 4 sheets, 35 tools, 13 gaps 04 MCP gateways and registries MCP specification, 2026-07-28 1 MCP spec Official MCP Registry 2 MCP Registry Docker MCP Gateway 3 Docker Gateway Obot 4 Obot Microsoft MCP Gateway 5 Microsoft gateway Mintive 6 Mintive Kong AI Gateway 7 Kong Cloudflare MCP server portals 8 Cloudflare portals Amazon Bedrock AgentCore Gateway 9 AgentCore Gateway Open gap a a Open gap b b Open gap c c Open gap d d Open gap e e 05 Identity and secrets Okta Cross App Access 1 Cross App Access Auth0 Token Vault 2 Token Vault Microsoft Entra Agent ID 3 Entra Agent ID Aembit 4 Aembit Teleport 5 Teleport SPIFFE 6 SPIFFE Open gap a a Open gap b b 06 Shadow AI and ghost jobs Nudge Security 1 Nudge Harmonic Security 2 Harmonic Reco 3 Reco Microsoft Purview for AI 4 Purview Healthchecks.io 5 Health checks Cronitor 6 Cronitor Sentry Crons 7 Sentry Crons Open gap a a Open gap b b Open gap c c 07 Sandboxing and containment Claude Code sandbox 1 Claude Code sandbox Codex sandboxing 2 Codex nono 3 nono Docker Sandboxes 4 Docker Sandboxes E2B 5 E2B Hosted sandboxes 6 Hosted sandboxes Apple container 7 Apple container Anthropic Sandbox Runtime 8 Sandbox Runtime Agent hooks 9 Agent hooks Claude Code managed settings 10 Managed settings How we built Claude Code auto mode 11 Auto mode The lethal trifecta 12 Lethal trifecta OWASP LLM06: Excessive Agency 13 OWASP LLM06 Open gap a a Open gap b b Open gap c c LAYER 3 PAY FOR IT Layer total 2 sheets 13 tools on the map 7 open gaps 08 Spend governance Claude plans and pricing 1 Claude plans Claude Code cost controls 2 Claude Code costs GitHub budgets and alerts 3 GitHub budgets LiteLLM 4 LiteLLM Cloudflare AI Gateway 5 Cloudflare AI Gateway Vantage for Anthropic 6 Vantage Open gap a a Open gap b b Open gap c c Open gap d d 09 Routing and model lifecycle Anthropic model deprecations 1 Claude dates OpenRouter Auto Router 2 OpenRouter Auto Microsoft Foundry model router 3 Foundry router Amazon Bedrock intelligent prompt routing 4 Bedrock routing Not Diamond 5 Not Diamond Requesty 6 Requesty RouteLLM 7 RouteLLM Open gap a a Open gap b b Open gap c c LAYER 4 FEED IT, STAFF IT, SELL IT 4 sheets, 42 tools, 15 gaps 10 Context layer and memory Glean 1 Glean Onyx 2 Onyx Credal 3 Credal Dust 4 Dust msgvault 5 msgvault AGENTS.md 6 AGENTS .md Mem0 7 Mem0 Open gap a a Open gap b b Open gap c c Open gap d d Open gap e e 11 Hiring and verification Greenhouse Real Talent 1 Greenhouse Real Talent Pindrop 2 Pindrop Karat 3 Karat CoderPad 4 CoderPad Open gap a a Open gap b b 12 Discovery and selling first User Interviews 1 User Interviews Respondent 2 Respondent Boardy 3 Boardy Happenstance 4 Happen stance Clay 5 Clay Listen Labs 6 Listen Labs Synthetic Users 7 Synthetic Users Synthetic Users: If, When, and How to Use AI-Generated Research 8 NN/g article Open gap a a Open gap b b Open gap c c 13 Agent harnesses Claude Code 1 Claude Code OpenAI Codex 2 Codex Gemini CLI 3 Gemini CLI GitHub Copilot agents 4 Copilot agents Cursor 5 Cursor OpenCode 6 OpenCode Goose 7 Goose Cline 8 Cline Pi, and its fork omp 9 Pi Claude Agent SDK 10 Claude Agent SDK OpenAI Agents SDK 11 OpenAI Agents SDK Google Agent Development Kit 12 Google ADK Microsoft Agent Framework 13 Agent Framework Strands Agents 14 Strands LangGraph 15 LangGraph Effective harnesses for long-running agents 16 Harness guide Paradev, formerly Superset 17 Paradev Orca 18 Orca Herdr 19 Herdr Paseo 20 Paseo Symphony 21 Symphony Stripe Minions 22 Stripe Minions StrongDM's software factory 23 StrongDM factory Open gap a a Open gap b b Open gap c c Open gap d d Open gap e e
Sheet 09: numbers are tools, letters are gapsOne sheet to the view5 tools

← → move to the next sheet over, Esc zooms out.

The problem, in plain words

Not every prompt needs the most expensive model. A router decides which model answers each request, by price, speed or how hard the task looks. The other half of the job is lifecycle: the model you tuned your prompts against has a retirement date, and its replacement behaves differently.

A router is the dispatcher at a cab company, sending the short hop to the small car and the airport run to the van. Lifecycle is the fleet: every car is retired on a schedule, and the replacement handles differently in the rain.

Routing by price and benchmark is now a commodity, with free options from cloud and gateway vendors. Routing by your own taste, by which model's work your team actually accepts, is still something you build.

Words you'll hear

Router
A layer that picks which model answers each request.
Fallback
A second model that answers when the first fails or is down.
Pinned model
A prompt that names an exact model version, so it breaks when that version retires.
Deprecation
The notice that a model will be retired, and the date it stops answering.
Eval-gated swap
Changing models only after the golden set passes on the new one.

What to understand, and what to decide

Understand

Decide

Who's working on it

Every link opened on 11 Nov 2026. The numbers match the squares on the map.

  1. Anthropic model deprecations

    Reference, Anthropic

    Which Claude models are active, deprecated or retired, with retirement dates and recommended replacements.

    The catch. At least 60 days' notice. Put the page on a weekly check, because nothing polls it for you.

  2. OpenRouter Auto Router

    Product

    Picks a model and a reasoning effort for each request, from the models your allow-list, data-retention rules and keys permit.

    The catch. It optimizes for general quality and price. Your taste isn't in its training data.

  3. Microsoft Foundry model router

    Product, Microsoft

    A deployable router that picks among models in Foundry for each prompt, with a balanced default mode.

    The catch. The effective context window is limited by the smallest model in the pool.

  4. Amazon Bedrock intelligent prompt routing

    Product, AWS

    One endpoint that predicts response quality and routes between foundation models in the same model family.

    The catch. Optimized for English prompts, and it can't learn from your own application's results.

  5. Not Diamond

    Product

    Model routing built for coding agents, aiming for frontier quality at a lower price.

    The catch. The quality and savings figures are the vendor's own. Test it on your golden set.

  6. Requesty

    Product

    A gateway to hundreds of models through one API, with routing, failover to the next model, spend limits and observability.

    The catch. One more party in the path of every prompt. Check where it stores what it sees.

  7. RouteLLM

    Open source, Apache-2.0

    A framework for serving and evaluating LLM routers, so you can train one on your own data.

    The catch. Its repository hasn't been updated since August 2024. Read it as a worked example, not a maintained product.

Still nobody sells

  1. Routing learned from your own acceptance data instead of public benchmarks.
  2. Governed routing for the everyday chat user, who shouldn't have to know which model is answering.
  3. Prompt migration as a service: the regression run, the scored diff and the pull request.

I wrote about this