jif-oai
ea225df22e
feat: context compaction ( #3446 )
...
## Compact feature:
1. Stops the model when the context window become too large
2. Add a user turn, asking for the model to summarize
3. Build a bridge that contains all the previous user message + the
summary. Rendered from a template
4. Start sampling again from a clean conversation with only that bridge
2025-09-12 13:07:10 -07:00
..
2025-09-12 13:07:10 -07:00
2025-09-10 17:38:11 -07:00
2025-09-11 11:59:37 -07:00
2025-09-12 13:07:10 -07:00
2025-09-02 17:29:58 +00:00
2025-09-11 22:01:25 +00:00
2025-08-14 17:59:01 -07:00
2025-09-02 19:49:03 -07:00
2025-09-12 12:06:33 -07:00
2025-09-12 13:07:10 -07:00
2025-08-13 13:38:18 -07:00
2025-09-12 13:07:10 -07:00
2025-09-12 11:35:51 -07:00
2025-09-05 10:41:47 -07:00
2025-09-08 08:12:08 -07:00
2025-09-12 13:07:10 -07:00
2025-09-12 13:07:10 -07:00
2025-09-10 17:42:54 -07:00
2025-08-29 02:16:39 +00:00
2025-09-10 02:32:57 +00:00
2025-09-11 11:59:37 -07:00
2025-09-11 22:01:25 +00:00
2025-09-11 11:59:37 -07:00
2025-08-14 17:59:01 -07:00
2025-09-04 08:21:58 -07:00
2025-08-07 10:13:13 -07:00
2025-09-11 11:59:37 -07:00
2025-09-11 15:04:29 -07:00
2025-08-19 13:22:02 -07:00
2025-08-14 15:47:48 -07:00
2025-09-11 15:04:29 -07:00
2025-09-10 16:14:41 -07:00
2025-08-22 22:18:54 +00:00
2025-09-08 17:54:47 -04:00
2025-09-09 15:02:02 -07:00
2025-09-11 09:16:34 -07:00
2025-09-12 13:07:10 -07:00
2025-09-12 14:24:09 -04:00
2025-09-11 11:59:37 -07:00
2025-08-22 22:18:54 +00:00
2025-09-11 11:59:37 -07:00
2025-09-11 11:59:37 -07:00
2025-09-08 16:28:52 -07:00
2025-09-11 11:59:37 -07:00
2025-09-11 11:59:37 -07:00
2025-08-20 04:51:59 +00:00
2025-08-20 16:54:26 +00:00
2025-09-11 22:01:25 +00:00
2025-09-02 17:38:19 -07:00
2025-09-02 17:38:19 -07:00
2025-09-10 17:38:11 -07:00
2025-09-11 11:59:37 -07:00
2025-09-04 05:34:50 +00:00
2025-08-14 17:59:01 -07:00
2025-09-02 17:29:58 +00:00