Skip to content

Run tests and rerun the failures

There are a few places to kick off a run, one run-config popover that governs them all, a queue that holds runs until a slot frees up, and two flavors of rerun. This guide walks the whole path.

For where a run executes (Marriska’s cloud vs. your own machine) and why you’d choose each, see Cloud vs. local.

FromHowWhat runs
A single testRun Test in the test editorJust that test (its data rows expand into iterations)
A test setThe on the set headerEvery test in the set, as a batch
A tagRun by tag on the Runner pageEvery test carrying the tag, across all projects
A scheduleRun now on the scheduleThe schedule’s test sets, immediately

Set runs, tag runs, and run-now all open the same popover before they start:

  • Browsers — check any of Chromium, Firefox, WebKit. Each browser is a separate execution, so two browsers doubles the run count (and the quota cost). Free runs Chromium only — Firefox and WebKit need Starter.
  • Execute onCloud (default) or Local. Local is greyed out until you have a local agent connected.
  • Run now — commits it. There’s no separate confirm step; this is it.

Runs don’t all start at once. How many your org executes simultaneously is your plan’s parallel-executions limit (1 on Free and Starter, more on Pro and up — see plan tiers). Extra runs sit in the Execution Queue on the Runner page until a slot opens.

While a run is still pending, you can:

  • Reorder it — drag pending runs to change which goes next.
  • Remove it — drop it from the queue before it starts (its status becomes removed).
  • Change its target — flip a pending run between Cloud and Local.

From a run in your history you get two rerun buttons:

  • Rerun all — runs the whole set again, fresh.
  • Rerun Failed — runs only the tests that failed, and only on the browsers that failed. For a parameterized test, it reruns just the data rows that failed, not all of them. This is the fast way to confirm a fix without paying for the green tests again.

If you have a local agent connected, rerunning first asks “Where should this run?” — Cloud or Local. With no agent, it goes straight to cloud.

ActionWhereResult
Stop one runThe run’s stop controlStatus → stopped
Stop AllRunner dashboardStops the active run and clears the queue
Stop one test in a running setThe test’s rowThat test stops; the set continues
Remove a queued runThe pending run’s menuStatus → removed (it never starts)

Stopping is a deliberate, confirmed action for the bulk options — “Stop All” asks first, because it also wipes everything waiting in the queue.

Cloud runs stream step events back live — you’ll see each step flip from running to passed/failed in real time, with screenshots arriving as they go. To watch the actual browser window drive itself, run local with the agent’s headed mode. When the run lands, read it in the report.