Maxim AI release notes www.getmaxim.ai

New

• We have launched a fully customizable RBAC controls on Maxim.
• It comes with 4 built in roles
  • Super Admin
  • Admin
  • Contributor
  • Viewer
• You can customize and change capabilities for each of these roles.
• You can add custom roles in addition to these built in roles.

New

• You can now add Javascript based Prompt Tools in your workspace.

• And use it in the same way as API based prompt tool

New

• You can now override the default concurrancy per API key for any model + model provider from Settings.
• Go to Settings > Model Config > Select Provider > Select API Key > Change concurrency.

New

• We have revamped the entire Evaluators on Maxim experience.
• All the built in and third party evaluators will be available for installing in your workspace via Evaluator Store.
• We currently have 35+ evaluators available on the Evaluator Store.

Please reach out to us, if you want us to add any open source third party evaluators on the platform.

New

• We have added support for one more provider - Amazon Bedrock
• Currently we have enabled two models deployed on Amazon Bedrock
  • Cloude 3 Haiku
  • Cloude 2

Please reach out to us if you would like us to expand the list of the models, or add support fine-tuned models deployed on Amazon Bedrock

New

• You can now create datasets for testing vision models.
• You have to select image asthe dataset type while creating a dataset.

• Each input column will have ability to upload the images

New

• Our prompt playgrounds now support Vision models. Currently we have enabled
  • OpenAI GPT-4 Vision Preview (both)
  • Cloude Haiku (On Bedrock)

New

• We have improved our Prompt Playground UX to help you experiment with various scenarios like Tool calls, multi-turn conversations, adding RAG pipelines etc.

New

• You can now create or update datasets from your log repository.

Improvement

• We have added sorting support to logs table.

New

You can use the vertical menu icon at the end of every test run entry row to rerun an entry and click on Rerun this entry.