Skip to content

docs: split transparent LLM summarization into the summarizer ChiMod - #21

Merged
lukemartinlogan merged 1 commit into
mainfrom
summarizer-chimod
Aug 27, 2026
Merged

docs: split transparent LLM summarization into the summarizer ChiMod#21
lukemartinlogan merged 1 commit into
mainfrom
summarizer-chimod

Conversation

@lukemartinlogan

@lukemartinlogan lukemartinlogan commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Documents the split of the summarizing LLM out of clio_cae_core into its own ChiMod, clio_cae_summarizer (pool 401.0).

Pairs with the code change in iowarp/clio-core#1026. Merging this before that lands would document a module that does not exist yet, so the two should go together.

What changed in the code

The summarizer is an interposer on the CTE core's task interface — the same pattern as cache / replication / indexer / compressor. It speaks the core's method ids and task structs, overrides exactly one verb (PutBlob), and forwards every other core method to next_pool_id untouched.

The practical consequence for users: label_endpoint, label_prompts, and label_matches move off the clio_cae_core pool entry and onto a new clio_cae_summarizer entry, with the CAE core's next_pool_id re-pointed at it.

Pages

  • deployment/configuration.md — removes the labeling keys from the CAE core parameter table and the "Transparent LLM labeling" subsection. Adds a Summarizer Module Parameters section: the pool-level keys, a per-label_matches-field table (including context_length's double role as the chunking budget and num_predict's interaction with chunking), a compose example showing the required ordering, and two admonitions — inference is synchronous on the handling worker, and the summary blob is written below the summarizer so blob_re: ".*" cannot loop.

  • sdk/context-transfer-engine/chimod-chain.md — adds a Summarizer ChiMod section next to the other interposers, since it speaks the same vocabulary even though it ships in the CAE package. Adds it to the well-known pool-id table, extends the separation-of-concerns note (summarizer = enrichment), and adds a note under "Putting it together" that it is opt-in and not part of the shipped default chain — it normally sits on the assimilation path, not the filesystem one, because every matched rule costs an LLM round-trip on the write path.

  • sdk/context-assimilation-engine/overview.md — two lines noting CAE now ships a second ChiMod, linking to both of the above.

Verification

npm run build passes. The config sets onBrokenLinks: 'throw', so the new cross-page and anchor links are checked by that build.

🤖 Generated with Claude Code

https://claude.ai/code/session_01RBv432JWeCysKtfAeVoob8

The summarizing LLM moved out of clio_cae_core into its own interposer
ChiMod, clio_cae_summarizer (pool 401.0). It speaks the CTE core's task
interface, overrides only PutBlob, and forwards every other core verb to
next_pool_id -- so the label_endpoint / label_prompts / label_matches keys
move off the CAE core's pool entry and onto its own.

- deployment/configuration: drop the labeling keys from the CAE core table,
  add a Summarizer Module Parameters section with the full per-rule field
  table, compose ordering, and the synchronous-inference caveat.
- chimod-chain: document the summarizer alongside cache/replication/indexer/
  compressor -- it ships in CAE but interposes on the same vocabulary. Adds
  it to the well-known pool-id table and notes it is opt-in, not part of the
  shipped default chain.
- context-assimilation-engine/overview: point at both of the above.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01RBv432JWeCysKtfAeVoob8
@lukemartinlogan
lukemartinlogan merged commit 22c81a9 into main Aug 27, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant