Tools may return large data items, which easily flood the context window if passed around via the LLM.
Consider whether we should have a way to bypass the context window for such payloads, or whether the tools simply have to be built in the right way in the first place, to pass handles around, rather than the payload.
Tools may return large data items, which easily flood the context window if passed around via the LLM.
Consider whether we should have a way to bypass the context window for such payloads, or whether the tools simply have to be built in the right way in the first place, to pass handles around, rather than the payload.