New
We’ve made evaluations on Maxim logs fully configurable. Instead of being limited to predefined parameters like input, output, retrieval, etc, you can now decide exactly which value in your trace or session should serve as the “input,” “output,” or any other field for your evaluators.
Key highlights of Flexi evals:
- Custom mapping: Configure any element of a trace/session to serve as evaluator fields, such as inputs, outputs, etc.
- Programmatic flexibility: Create custom code blocks (in JS) to extract or combine fields and map them to any evaluator parameter. You can pull values from JSON, perform string manipulations, or apply validations to shape evaluations however you need.
This gives teams greater control over how evaluations are run on Maxim – allowing them to focus on specific areas of LLM interactions, eliminate noise from evaluation parameters, and generate more precise, actionable insights.