Tomas Cupr 4760aa1eb9 perf: optimize token streaming with balanced approach (#635) ...

- Replace setTimeout(10ms) with queueMicrotask for immediate processing
- Add minimal 3ms setTimeout for rendering to maintain readable UX
- Reduces per-token delay while preserving streaming experience
- Add performance test to verify optimization works correctly

---------

Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Thibault Sottiaux <tibo@openai.com>

2025-04-25 10:49:38 -07:00

3.3 KiB

Raw Blame History

View Raw