Commit Graph

6 Commits

Author SHA1 Message Date
toyamagu-2021 d3beeace95 fix: use safe_truncate to truncate charactor (#3263) (#3264)
Signed-off-by: toyamagu2021@gmail.com <toyamagu2021@gmail.com>
2025-07-15 12:34:40 +02:00
Jack Amadeo fde3a578a5 feat: stream LLM responses (#2677)
Co-authored-by: Michael Neale <michael.neale@gmail.com>
2025-07-14 14:57:03 -04:00
Salman Mohammed 75454b96da feat: use tiktoken-rs instead of tokenizers, single global tokenizer (#3115)
Co-authored-by: jack <>
2025-07-01 14:42:51 -04:00
jack 495cdfb33c feat: implement async token counter with network resilience and performance optimizations (#3111)
Co-authored-by: jack <>
Co-authored-by: Salman Mohammed <smohammed@squareup.com>
2025-06-30 08:45:17 -04:00
Michael Neale 6eac86b97e fix: large sessions summarize/truncate (#2846) 2025-06-11 14:17:24 +10:00
Salman Mohammed fd1f829751 feat: present options to user when context length is exceeded (#2207)
Co-authored-by: Yingjie He <yingjiehe@squareup.com>
2025-04-23 17:19:32 -07:00