Web regression testing

Point a test plan at an environment URL and a device preset for each web application.

A web test plan runs the tests you selected against the environment configured for each application. Change the URL or the device without rewriting the tests.

Environment URL

On the test plan, open Parameters. Each application that has tests in the plan has an Environment. That environment’s URL is where those tests run.

Override the URL for one run from CI or the API. Pass environment.url for the application short ID. The override wins over the plan parameter, which wins over the project default.

{
  "testPlanShortId": "pln_abc123",
  "applications": [
    {
      "applicationShortId": "app_abc123",
      "environment": { "url": "https://staging.example.com" }
    }
  ]
}

See Test plan parameters and Start Run.

Device preset

The same Parameters card sets a Device Preset for that application, or Default to use the project default. A run can also pass devicePresetShortId.

Device presets cover viewport, user agent, and headers for the browser. See Device Presets.

Run it from CI

GitHub

Test Run Action with a preview URL or environment override.

GitLab

POST /v1/run with the environment URL for that deploy.

Bitrise

One HTTP request with the test plan short ID.

API

Start the plan from any CI that can send an HTTPS request.