Commit Graph
2 Commits
Author SHA1 Message Date
ZacharyZhang-NY fb6d2a0d77 fix(runtime): tokenize context compaction budget 2026-04-22 16:00:12 -04:00
ZacharyZhang-NY b100bdcc10 追加 C3 真实 tokenizer 迁移 proposal
C3 首轮落地的 2 chars/token 是中间态,根治方案是换 tiktoken 或等 pi-ai
暴露 tokenizer。proposal 记录了备选依赖(tiktoken / anthropic-tokenizer /
count_tokens API)的 trade-off,以及保留 estimateTokens 签名不变的迁移契约。
2026-04-20 10:59:55 -04:00