New
The Expected Tool Calls column allows you to specify the tools you expect an agent to use in a scenario, ensuring the AI agent is choosing and invoking the correct tools as part of its reasoning process.
This column has been improved with the addition of powerful combinators for flexible evaluation of agent behavior:
inAnyOrder: Allows you to specify multiple tool calls that can be executed in any sequence while still being considered valid. This is perfect for scenarios where the order of operations doesn't matter.anyOne: Enables you to define alternative tool calls where any single one satisfies the requirement. This is ideal for cases where multiple approaches can achieve the same outcome.
This provides greater flexibility when evaluating agent behavior, particularly in complex scenarios with multiple valid solution paths. Learn more about Expected Tool Calls column .
