Maxim AI release notes www.getmaxim.ai

New

Maxim launches a new feature to add new evaluators to existing test run reports.

With this feature, you can:

• Add evaluators to existing runs: Directly add new evaluators to an already completed test run without modifying the original setup.
• Save time and costs: Avoid rerunning for all evaluators, reducing computational costs by running the entries only for the newly added evaluators.
• Streamlined workflow: No need to return to the test configuration page—simply update the existing run and evaluate the new results efficiently.

This feature enables more flexible, cost-effective, and efficient testing, helping you improve your workflow.

New

We’re excited to introduce Tags in test run reports, a new feature designed to streamline your analysis process on the Maxim platform.

With this update, you can now:

• Tag, specific test runs: Assign tags to individual test runs for better organization and easier reference.
• Preserve tagged runs: When re-running a test, the tagged version will remain saved, while the new run is stored as a separate report.
• Filter by tags: Easily search and filter test runs by tags, allowing for faster retrieval and targeted analysis.

New

Maxim now offers dataset management, streamlining the way you create, update, and organize your datasets. With folder-based organization, you can now:

• Easily create, update, and organize datasets.
• Reduce the overhead associated with managing datasets.

New

Maxim now supports viewing outputs in markdown format within your test run reports. This feature allows you to:

• Display test run outputs with proper formatting, including headings, lists, code blocks, and more.
• Improve the readability and presentation of your outputs by using markdown syntax.

By enabling markdown, you can organize and structure the information more effectively, making it easier to interpret and share test results with your team or external stakeholders.

New

Maxim now allows you to customize the table layout in your test run reports. With this feature, you can:

• Reorder columns to suit your preferences.
• Pin columns to the left or right for easier viewing.
• Resize columns to create a flexible, personalized view.

This update is designed with a user experience similar to popular tools like Excel and Google Sheets, enabling a familiar and seamless experience.

New

Maxim now offers an enhanced comparison view for test runs. With this feature, you can:

• View a comprehensive comparison of all entities.
• Grouped input column, output column, and other relevant columns for each entity being compared.

This new mode provides a clearer, more organized way to evaluate multiple entities side by side.

New

We now support the creation of custom programmatic evaluators in Python, expanding beyond JavaScript to give you even more flexibility.

While we provide a wide range of global standard evaluators out of the box, we understand that some applications require tailored solutions. With this update, you can easily create Python-based evaluators to fit your specific needs.

• Custom evaluators: Write your own custom logic using Python, allowing you to define pass/fail criteria directly within your code.
• Seamless integration: Once created and tested, these evaluators can be saved and smoothly integrated into your workflows or prompt chains.

This new Python support ensures a more versatile and powerful evaluation experience.

New

Maxim now offers a detailed billing settings page, providing users with a comprehensive view of their subscription and payment details.

Key features:

• Plan overview: Displays the current plan, the number of active seats, the next billing date, and the total invoice amount. Users can choose to either Cancel plan or Upgrade directly from this section.

• Billing notifications: Shows the email address that will receive billing-related notifications. This ensures that all important updates about your plan are delivered promptly.

• Card details: Users can view and edit their stored payment method, allowing for easy updates to billing information.

• Invoice details: Provides key billing information, including the billing name, contact email, and address details. Users can edit any of this information for accuracy.

• Invoice history: Lists the detailed history of past invoices, including the dates, descriptions, and amounts for each invoice. Users can easily view specific invoices by clicking the View link next to each one.

To access the page:

1. Click on the Settings icon located at the top-right corner of the homepage.
2. Under the Account settings section, select Billing.

This new layout streamlines the billing management process, offering both clarity and ease of use for managing subscription details and payment information.

New

We’ve revamped the prompt header with updates to versions and sessions. Here are the key highlights, along with a video walkthrough.

You now have two distinct actions: Save session and Publish version.

• Save Session: Protect your work from data loss by saving all session details, including user messages and variable values. The session list allows you to track changes over time, enabling quick iterations and easy updates. If there are unsaved changes, a red * will appear next to the prompt name.

• Publish Version: Publishing a version is now a more deliberate action used when you want to capture a specific state of the prompt for testing or deployment. A version stores the system and (optionally) user messages. You can access the version list via a popover, allowing for one-click switching between versions.

Additionally, the Deploy action and Deployments list are now conveniently accessible right from the header!

New

Maxim now introduces the ability to toggle columns in your test run reports, offering enhanced customization for viewing and sharing test data.

With this feature, users can:

• Show or hide specific columns from the dataset, such as input, expected output, or other relevant fields.
• Adjust columns from the test run itself, including output, retrieved-context, and evaluator details.

Key benefits:

• Tailored Views: Customize the report layout to focus on the data that matters most.
• Selective Sharing: Control which columns are visible when sharing reports with external stakeholders, ensuring only necessary information is displayed.

To use the Toggle Columns feature:

1. Navigate to the Runs tab in Maxim.
2. Open any Test run report.
3. Click on the Toggle columns option.
4. Select the columns you wish to display or hide from the dataset or test run, such as input, expected output, output, retrieved-context, or evaluator details.

This allows you to customize the view of your report before sharing it. This gives you full flexibility over what your recipients see when sharing reports.