Introduction
Understanding the basics of Ottic
Ottic is a QA platform for LLM products that lets you test and continuously improve your LLM product.
With Ottic, you can create and manage test cases and prompts, execute test runs and generate informative reports on your LLM product performance.
View interactive demo
Interested in seeing Ottic in action?
Schedule a call to see how Ottic fits your projects.
User flow
Here’s what the core user flow in Ottic looks like:
Add Your Prompt
Create the initial prompt to begin testing.
Write Your Test Cases
Define test cases and specify the expected behavior of your application.
Execute Test Runs
Run tests and review reports on successes and areas needing improvement.
Publish Your Prompt
Publish your prompt directly to production from Ottic.
This documentation will guide you through this process in detail.
Request your migration here.
Essentials
Creating prompts
Create, manage and publish prompts versions
Defining test cases
Define scenarios to assess your LLM’s responses
Executing test runs
Execute tests, analyze results, and identify improvement areas.
Datasets
Manage datasets to support context (RAG)