Commit Graph

7 Commits

Author SHA1 Message Date
David Katz 80826c2b23 Token counting reliability + summarization integration. (#3721) 2025-08-14 11:23:37 -04:00
Jack Amadeo 5eb01004a4 chore: use a Conversation type (#3735) 2025-08-06 22:06:13 -04:00
Salman Mohammed 75454b96da feat: use tiktoken-rs instead of tokenizers, single global tokenizer (#3115)
Co-authored-by: jack <>
2025-07-01 14:42:51 -04:00
jack 495cdfb33c feat: implement async token counter with network resilience and performance optimizations (#3111)
Co-authored-by: jack <>
Co-authored-by: Salman Mohammed <smohammed@squareup.com>
2025-06-30 08:45:17 -04:00
Michael Neale 6eac86b97e fix: large sessions summarize/truncate (#2846) 2025-06-11 14:17:24 +10:00
Salman Mohammed 199fa6adbc chore: refactor read-write lock on agent (#2225)
Co-authored-by: Alice Hau <ahau@squareup.com>
2025-04-23 22:46:22 -04:00
Salman Mohammed fd1f829751 feat: present options to user when context length is exceeded (#2207)
Co-authored-by: Yingjie He <yingjiehe@squareup.com>
2025-04-23 17:19:32 -07:00