AnthropicTools
Claude API adds message threads so long agent loops send only new messages
In public beta, message threads keep a Messages API conversation on Anthropic's servers between turns, so each later request carries only new messages. Anthropic reports about 35% lower median time to first token on 500k to 1M token requests. Token usage and prices stay the same.
Image: Anthropic










