Commit Graph

5 Commits

Author SHA1 Message Date
Alex Hancock 76da3a9724 feat: switch from mcp_core::Role to rmcp::model::Role (#3488) 2025-07-18 12:30:23 -04:00
Jack Amadeo fde3a578a5 feat: stream LLM responses (#2677)
Co-authored-by: Michael Neale <michael.neale@gmail.com>
2025-07-14 14:57:03 -04:00
Salman Mohammed 75454b96da feat: use tiktoken-rs instead of tokenizers, single global tokenizer (#3115)
Co-authored-by: jack <>
2025-07-01 14:42:51 -04:00
jack 495cdfb33c feat: implement async token counter with network resilience and performance optimizations (#3111)
Co-authored-by: jack <>
Co-authored-by: Salman Mohammed <smohammed@squareup.com>
2025-06-30 08:45:17 -04:00
Salman Mohammed fd1f829751 feat: present options to user when context length is exceeded (#2207)
Co-authored-by: Yingjie He <yingjiehe@squareup.com>
2025-04-23 17:19:32 -07:00