pi-mono/packages/coding-agent/src/extensions
Steve Immanuel 0c32e83a35
fix(coding-agent): enable streaming usage for llama.cpp provider (#7258)
llama-server supports OpenAI-spec stream_options.include_usage since
b2b6b55a59 (Sep 2025); any server new enough for router mode sends the
final usage chunk when requested. With the flag hardcoded to false the
provider never requests it, so streamed responses record zero tokens
and session/context accounting stays empty.

Verified against llama-server b10094: with include_usage sent, the
final chunk carries usage (incl. prompt_tokens_details.cached_tokens);
without it, nothing.
2026-07-29 10:03:59 +02:00
..
llama fix(coding-agent): enable streaming usage for llama.cpp provider (#7258) 2026-07-29 10:03:59 +02:00
index.ts feat(coding-agent): add llama.cpp router integration 2026-07-17 16:25:00 +02:00