2 Commits

Author	SHA1	Message	Date
jif-oai	611e00c862	feat: compactor 2 (#6027) ... Co-authored-by: pakrym-oai <pakrym@openai.com>	2025-10-31 14:27:08 -07:00
jif-oai	ea225df22e	feat: context compaction (#3446) ... ## Compact feature: 1. Stops the model when the context window become too large 2. Add a user turn, asking for the model to summarize 3. Build a bridge that contains all the previous user message + the summary. Rendered from a template 4. Start sampling again from a clean conversation with only that bridge	2025-09-12 13:07:10 -07:00