2 Commits

Author	SHA1	Message	Date
Ahmed Ibrahim	bbea6bbf7e	Handle resuming/forking after compact (#3533) ... We need to construct the history different when compact happens. For this, we need to just consider the history after compact and convert compact to a response item. This needs to change and use `build_compact_history` when this #3446 is merged.	2025-09-14 13:23:31 +00:00
jif-oai	ea225df22e	feat: context compaction (#3446) ... ## Compact feature: 1. Stops the model when the context window become too large 2. Add a user turn, asking for the model to summarize 3. Build a bridge that contains all the previous user message + the summary. Rendered from a template 4. Start sampling again from a clean conversation with only that bridge	2025-09-12 13:07:10 -07:00