Shiplight vs testRigor: Intent-Based Testing Compared

Both Shiplight and testRigor promise the same thing: write end-to-end tests without code, and let AI handle the maintenance. Both use intent-based approaches instead of brittle DOM selectors. Both claim self-healing. But they're built for different teams and different workflows. testRigor is designed for non-technical testers who want to write in plain English. Shiplight is designed for developers and engineering teams who build with AI coding agents and want tests in their repo. We build Shiplight, so we have a perspective. This comparison is honest about where testRigor excels and where we think Shiplight is the better fit.

Quick Comparison

How They Work — Side by Side

testRigor: Plain English Testing

testRigor's core idea is that tests should be written from the end user's perspective in plain English. No selectors, no code, no framework knowledge. A testRigor test looks like this:

login
click "New Project"
check that page contains "Project created successfully"
enter "My Project" into "Project Name"
click "Save"
check that page contains "My Project"

The platform interprets these instructions at runtime using AI and a proprietary language engine. It supports over 2,000 browser combinations, mobile apps (iOS and Android), desktop applications, and API testing. Strengths:

• Lowest barrier to entry for non-technical users
• Broad platform coverage (web, mobile, desktop, API)
• 2,000+ browser combinations
• AI-powered test generation from recordings or descriptions
• Tests require 95% less maintenance than Selenium-based alternatives

Trade-offs:

• Tests exist only in testRigor's cloud — no repo copy, no export
• Plain English syntax still has conventions to learn
• Limited granular control for complex test scenarios
• Less developer-oriented than code-based or YAML-based tools
• Pricing starts at $300/month with 3-machine minimum

Shiplight: YAML Intent Testing in Your Repo

Shiplight takes a different approach. Tests are YAML files with natural language intent statements combined with Playwright-compatible locators. They live in your git repo, are reviewable in PRs, and run anywhere Node.js runs. A Shiplight test looks like this:

goal: Verify user can create a new project
statements:
 - intent: Log in as a test user
 - intent: Navigate to the dashboard
 - intent: Click "New Project" in the sidebar
 - intent: Enter "My Project" in the project name field
 - intent: Click the Save button
 - VERIFY: the project appears in the project list

Shiplight's MCP server connects directly to AI coding agents (Claude Code, Cursor, Codex), so the agent that builds a feature can also verify it in a real browser and generate the test automatically. Strengths:

• Tests live in your repo (with Shiplight Cloud for managed execution) — version-controlled, reviewable in PRs
• Shiplight Plugin with AI coding agents
• Self-healing via intent + cached locators for deterministic speed
• Built on Playwright for cross-browser support
• YAML files are portable — you own your tests even with Shiplight Cloud
• SOC 2 Type II certified with VPC deployment

Trade-offs:

• Web-focused (no native mobile or desktop testing)
• More developer-oriented — less accessible for non-technical testers
• Newer platform with a smaller community
• No self-serve pricing page

The Core Difference: Who Writes the Tests?

Both tools are accessible without coding skills — but they're designed for different workflows. testRigor uses free-form plain English ("click the Submit button"). This makes test authoring easy for non-technical users, but tests live exclusively in testRigor's cloud with no export. Shiplight uses structured YAML with natural language intent. PMs, designers, and QA can all read and review Shiplight tests — but the tests also live in your git repo, run in CI, and integrate directly with AI coding agents via Shiplight Plugin. This makes Shiplight the better fit for teams where developers and AI agents are part of the testing workflow, while still being readable by the whole team.

Test Ownership and Portability

testRigor

Tests are created and stored exclusively in testRigor's cloud platform. You write them in testRigor's interface, and they execute on testRigor's infrastructure. There is no local copy and no export — the plain English format is proprietary to testRigor's interpreter. If you switch tools, you start over.

Shiplight

Tests are YAML files committed to your repository — the source of truth lives in git, not in a vendor's cloud. Shiplight Cloud provides managed execution, dashboards, scheduling, and AI-powered failure analysis on top of those same repo-based tests. You get the benefits of a cloud platform (managed infrastructure, team visibility, historical trends) without giving up ownership of your test assets. Why this matters: Both tools have cloud platforms. The difference is where your tests live. With testRigor, tests exist only in their cloud — no repo copy, no export, no portability. With Shiplight, tests are YAML files in your repo that also run in the cloud. If you leave Shiplight, your test specs stay with you.

Pricing

testRigor

testRigor starts at approximately $300/month with a minimum of 3 virtual machines. All tiers include unlimited test cases and unlimited users. As test suites grow, additional machines can be added to reduce execution time. This per-machine pricing can scale significantly for large test suites running frequently.

Shiplight

Shiplight Plugin is free with no account required — AI coding agents can start verifying and generating tests immediately. Platform pricing (cloud execution, dashboards, scheduled runs) requires contacting sales. Enterprise includes SOC 2 Type II, VPC deployment, RBAC, and 99.99% SLA. Honest assessment: testRigor wins on pricing transparency — you know what you'll pay before talking to sales. Shiplight's free Shiplight Plugin is a strong entry point, but platform pricing requires a conversation.

When testRigor May Fit

testRigor may be a fit if:

• Non-technical testers own QA. If your testing team doesn't code and shouldn't have to, testRigor's plain English approach has the lowest barrier to entry.
• You need mobile and desktop testing. testRigor supports iOS, Android, and desktop apps. Shiplight is web-focused.
• You want broad browser coverage. testRigor offers 2,000+ browser combinations out of the box.
• You need API testing built in. testRigor includes API testing natively. Shiplight handles APIs via inline JavaScript in YAML tests.
• You want transparent pricing. testRigor publishes plans and pricing. Shiplight requires contacting sales.

When to Choose Shiplight

Shiplight is the better fit when:

• You build with AI coding agents. Shiplight Plugin connects to Claude Code, Cursor, and Codex — the agent verifies its own work in a real browser during development.
• You want tests in your repo. YAML test files live alongside your code, are version-controlled, produce clean diffs, and are reviewable in PRs.
• Developers own testing. If engineers are writing and reviewing tests, YAML in git is a natural fit. Plain English in a separate platform adds context-switching.
• You need enterprise security. SOC 2 Type II, VPC deployment, immutable audit logs, RBAC, and 99.99% SLA are available. testRigor offers SOC 2 but fewer deployment options.
• You want no vendor lock-in. YAML specs are portable. testRigor's tests exist only in their cloud with no export.
• You need cross-browser with Playwright. Shiplight runs on Playwright, supporting Chrome, Firefox, and Safari/WebKit. testRigor has broader combinations but uses its own execution engine.

Frequently Asked Questions

Can testRigor tests be exported?

No. testRigor tests are written in the platform's proprietary plain English format and executed by testRigor's engine. They cannot be exported as Playwright, Cypress, or Selenium scripts. If you leave testRigor, you'd need to recreate tests in your new tool.

Does Shiplight support plain English testing?

Shiplight uses YAML with natural language intent statements rather than free-form plain English. The format is structured (intent + action + locator) which makes it deterministic and reviewable, but it requires slightly more structure than testRigor's conversational syntax.

Which tool has better self-healing?

Both use AI to handle UI changes. testRigor re-interprets plain English instructions on each run. Shiplight uses cached locators for speed and falls back to AI intent resolution when locators break — a two-speed approach that's faster for stable UIs but equally adaptive when things change.

Can I use both tools together?

In theory, yes — testRigor for mobile/desktop testing and Shiplight for web E2E integrated with AI coding agents. In practice, most teams choose one primary tool to avoid maintaining two test ecosystems.

What is intent-based testing?

Intent-based testing describes what a test should verify in natural language rather than how to interact with specific DOM elements. Both Shiplight and testRigor use this approach, but implement it differently — testRigor with free-form English, Shiplight with structured YAML intent statements.

Final Verdict

testRigor and Shiplight solve the same problem — brittle, high-maintenance E2E tests — but for different teams. testRigor may fit teams where non-technical testers own QA and mobile/desktop coverage is required. However, it comes with vendor lock-in (no test export) and higher costs ($300+/month). Shiplight is the stronger choice for teams where developers and AI coding agents drive the workflow. Tests live in your repo, self-heal automatically, and integrate directly into your coding agent via Shiplight Plugin — with enterprise-grade security and no vendor lock-in. Book a demo to see the difference.

Get Started

• Try Shiplight Plugin — free, no account needed
• Book a demo
• YAML Test Format
• Best AI Testing Tools in 2026
• Documentation

References: Playwright Documentation, SOC 2 Type II standard, Google Testing Blog