New
We now support the creation of custom programmatic evaluators in Python, expanding beyond JavaScript to give you even more flexibility.
While we provide a wide range of global standard evaluators out of the box, we understand that some applications require tailored solutions. With this update, you can easily create Python-based evaluators to fit your specific needs.
- Custom evaluators: Write your own custom logic using Python, allowing you to define pass/fail criteria directly within your code.
- Seamless integration: Once created and tested, these evaluators can be saved and smoothly integrated into your workflows or prompt chains.
This new Python support ensures a more versatile and powerful evaluation experience.