← Wednesday, October 21, 2026Models & trainingRelease

llm-echo 0.5 accounts for tool calls and reasoning tokens in simulated usage

simonwillison.net Editor score 6/10

The llm-echo debug plugin now includes tool calls, system prompts, and reasoning tokens in its simulated usage counts. That makes it more useful for testing LLM integrations without making real model calls.

What
llm-echo is a debugging plugin for LLM that provides a model which echoes prompts without calling an LLM.
How
Version 0.5 updates simulated token usage to account for tool calls, system prompts, and reasoning tokens.
Why it matters
Engineers can test LLM integrations and usage reporting without invoking a real model.

Discussion

Discussion is not switched on yet. Use Note above to keep your own thoughts on this story.

Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.

Your note

Private to you. Stored in this browser, and synced to your account when you are signed in.