valknar/llmx
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
763 Commits 9 Branches 11 Tags
596a9d6a96ff4e77ee2f9cc76b17e817e46e18a2
Commit Graph

3 Commits

Author SHA1 Message Date
easong-openai
52e12f2b6c Revert "Streaming markdown (#1920)" (#1981) 
This reverts commit 2b7139859e.
 2025-08-08 01:38:39 +00:00
easong-openai
2b7139859e Streaming markdown (#1920) 
We wait until we have an entire newline, then format it with markdown and stream in to the UI. This reduces time to first token but is the right thing to do with our current rendering model IMO. Also lets us add word wrapping!
 2025-08-07 18:26:47 -07:00
easong-openai
906d449760 Stream model responses (#1810) 
Stream models thoughts and responses instead of waiting for the whole
thing to come through. Very rough right now, but I'm making the risk call to push through.
 2025-08-05 04:23:22 +00:00