mirror of
https://github.com/badlogic/pi-mono.git
synced 2026-11-05 23:37:25 +00:00
962b130e0c
With compaction.inContext enabled, compaction can generate the summary inside the cached conversation: it repeats the request the next turn would send, appends the instructions as a system message plus a user message, and sets toolChoice none. The recent tail is kept as before. A gate requires a verified model, a warm cache from the same model and thinking level, room in the context window, and a lower estimated cost than the standalone summary. Failed or rejected attempts fall back to the standalone summary, never execute tools, and are recorded in details.inContext with their usage. pi-ai adds the supportsInContextCompaction compat setting and test/in-context-compaction-probe.ts, which measures whether a model keeps its prompt cache for this request shape. The generated catalog flags the models that passed. |
||
|---|---|---|
| .. | ||
| check-model-data.ts | ||
| generate-models.ts | ||
| generate-test-image.ts | ||
| hydrate-model-catalog.ts | ||
| model-data.ts | ||
| models-dev-reasoning-options.ts | ||
| openrouter-catalog.ts | ||
| openrouter-reasoning-options.ts | ||