Scenarios
Scenarios are groups of test cases that belong together. They are best organized around user flows, such as:- Login
- Product Search
- Add to shopping cart
- Checkout
- Notification Settings
- Successful purchase with valid payment details
- Order completion with fedex shipping
- Payment attempt with expired credit card (negative case)
- Checkout with empty cart (negative case)
Tests and Test Runs
Every time a test run is triggered, we run the selected scenarios. The result is a test run with one or more test cases in it.Filtering and Searching Results
When viewing test run results, you can quickly find specific tests using filters and search:- Filter by result - Show only PASSED, FAILED, or SKIPPED tests
- Filter by status - Filter tests by execution state (INITIATED, RUNNING, COMPLETED, ERROR, CANCELLED)
- Search by name - Find specific tests using the search box
- Filter by owner - Show only tests you own with the “Owned by me” filter. See Ownership
Result vs. Status: A test’s result is the outcome after completion
(PASSED/FAILED/SKIPPED), while status tracks the execution state. For
example, a test can have STATUS=COMPLETED with RESULT=FAILED.
Related documentation
- Test Plans - Group test cases and run them together
- Creating Tests - Write test cases the AI agent can run reliably
- How to review test results - Review results at each stage of your workflow