docs: split transparent LLM summarization into the summarizer ChiMod - #21
Merged
Conversation
The summarizing LLM moved out of clio_cae_core into its own interposer ChiMod, clio_cae_summarizer (pool 401.0). It speaks the CTE core's task interface, overrides only PutBlob, and forwards every other core verb to next_pool_id -- so the label_endpoint / label_prompts / label_matches keys move off the CAE core's pool entry and onto its own. - deployment/configuration: drop the labeling keys from the CAE core table, add a Summarizer Module Parameters section with the full per-rule field table, compose ordering, and the synchronous-inference caveat. - chimod-chain: document the summarizer alongside cache/replication/indexer/ compressor -- it ships in CAE but interposes on the same vocabulary. Adds it to the well-known pool-id table and notes it is opt-in, not part of the shipped default chain. - context-assimilation-engine/overview: point at both of the above. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RBv432JWeCysKtfAeVoob8
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Documents the split of the summarizing LLM out of
clio_cae_coreinto its own ChiMod,clio_cae_summarizer(pool401.0).Pairs with the code change in iowarp/clio-core#1026. Merging this before that lands would document a module that does not exist yet, so the two should go together.
What changed in the code
The summarizer is an interposer on the CTE core's task interface — the same pattern as cache / replication / indexer / compressor. It speaks the core's method ids and task structs, overrides exactly one verb (
PutBlob), and forwards every other core method tonext_pool_iduntouched.The practical consequence for users:
label_endpoint,label_prompts, andlabel_matchesmove off theclio_cae_corepool entry and onto a newclio_cae_summarizerentry, with the CAE core'snext_pool_idre-pointed at it.Pages
deployment/configuration.md— removes the labeling keys from the CAE core parameter table and the "Transparent LLM labeling" subsection. Adds a Summarizer Module Parameters section: the pool-level keys, a per-label_matches-field table (includingcontext_length's double role as the chunking budget andnum_predict's interaction with chunking), a compose example showing the required ordering, and two admonitions — inference is synchronous on the handling worker, and the summary blob is written below the summarizer soblob_re: ".*"cannot loop.sdk/context-transfer-engine/chimod-chain.md— adds a Summarizer ChiMod section next to the other interposers, since it speaks the same vocabulary even though it ships in the CAE package. Adds it to the well-known pool-id table, extends the separation-of-concerns note (summarizer = enrichment), and adds a note under "Putting it together" that it is opt-in and not part of the shipped default chain — it normally sits on the assimilation path, not the filesystem one, because every matched rule costs an LLM round-trip on the write path.sdk/context-assimilation-engine/overview.md— two lines noting CAE now ships a second ChiMod, linking to both of the above.Verification
npm run buildpasses. The config setsonBrokenLinks: 'throw', so the new cross-page and anchor links are checked by that build.🤖 Generated with Claude Code
https://claude.ai/code/session_01RBv432JWeCysKtfAeVoob8