How to Adopt Shiplight AI: A Practical Guide to MCP Server, Shiplight Cloud, and the AI SDK

January 1, 1970

How to Adopt Shiplight AI: A Practical Guide to MCP Server, Shiplight Cloud, and the AI SDK

Modern QA has a new constraint: software changes faster than test suites can keep up.

That is true even in disciplined teams with solid automation. It is even more true when AI coding agents are shipping UI changes at high velocity. The result is familiar: end-to-end coverage that starts strong, then collapses under maintenance, flaky selectors, and slow feedback loops.

Shiplight AI was built for this reality. It combines agentic, AI-native execution with approachable authoring workflows so teams can scale end-to-end coverage with near-zero maintenance, without forcing everyone into a single way of working.

This post breaks down the three primary ways teams adopt Shiplight, what each is best for, and how they fit together in a real rollout.

The core idea: keep the test intent human, make execution resilient

Traditional UI automation tends to bind test reliability to implementation details: selectors, DOM structure, and brittle assumptions about page timing. Shiplight flips the model. Tests are expressed as user intent in natural language, and the system resolves that intent at runtime, then stabilizes execution with deterministic replay where it matters.

In practice, that gives you a spectrum:

  • Natural-language steps that are readable and easy to author.
  • Deterministic replay when you want speed and consistency.
  • Self-healing behavior when the UI shifts and cached locators go stale.

That foundation shows up across every Shiplight interface: MCP, Cloud, Desktop, and the AI SDK.

Option 1: MCP Server for AI coding agents and local verification

If your team uses AI coding agents in an IDE or CI workflow, start here.

Shiplight MCP Server is designed to work alongside AI coding agents. The intent is simple: your agent implements a feature, opens a real browser, verifies the change, and can generate end-to-end tests as part of the same loop.

When MCP is the best fit

  • You want fast UI verification during development, not after the PR is opened.
  • You are building with tools like Claude Code, Cursor, or Windsurf.
  • You need a practical way to reduce “looks good to me” approvals by replacing them with evidence.

What it looks like day to day

The Quick Start flow focuses on adding Shiplight as an MCP server so your agent can drive a browser session, take screenshots, click through flows, and optionally use AI-powered actions when you provide a supported API key.

A small but important detail: Shiplight also documents a clean pattern for handling authenticated apps by logging in once manually and saving browser storage state so the agent can reuse the session without re-authenticating every time.

Option 2: Shiplight Cloud for team-wide test creation, execution, and operations

MCP is excellent for development-time verification. Shiplight Cloud is how teams operationalize end-to-end coverage.

Shiplight Cloud is positioned as a full test management and execution platform, including agentic test generation, a no-code test editor, cloud execution, scheduled runs, CI/CD integration, and test auto-repair.

When Cloud is the best fit

  • You need shared visibility: suites, schedules, results, and ownership.
  • You want parallelized cloud execution and an always-on release signal.
  • You want AI assistance for authoring and maintaining tests inside a visual workflow.

Two Cloud features teams feel immediately

1) AI-powered test generation inside the editor

Shiplight’s docs describe AI-assisted creation from a test goal (for example, “verify user can complete checkout”), plus “group expansion” that turns high-level steps into detailed actions.

2) Faster failure understanding with AI Test Summary

When a test fails, Shiplight Cloud can generate an AI summary that explains what happened, highlights expected versus actual behavior, and can analyze screenshots for visual context. It is built to reduce time spent spelunking logs and debating whether a failure is a product regression or test brittleness.

CI/CD: start with GitHub Actions

Shiplight provides a GitHub Actions integration that runs suites using a Shiplight API token, suite IDs, and an environment ID, with options for PR comments and outputs you can use for gating.

Option 3: Shiplight AI SDK for teams invested in Playwright

Some organizations already have meaningful automation coverage in Playwright. Rewriting that suite into a brand-new system is rarely the best ROI.

The Shiplight AI SDK is positioned as an extension to existing Playwright tests, adding AI-native execution, stabilization, and reliability while keeping tests in code and in normal review workflows.

When the SDK is the best fit

  • Your tests must remain code-first and live with the repo.
  • You want AI to improve execution and reduce flakiness, without changing how engineers structure the suite.
  • You want a path that preserves governance, review, and deterministic behavior in CI.

The connective tissue: YAML tests, VS Code, and Desktop

Shiplight supports a pragmatic “start local, scale when you need to” approach.

YAML tests that stay readable

Shiplight tests can be written in YAML using natural language steps, with enriched “action entities” and locators for deterministic replay. The docs are explicit that locators act as a cache, and the agentic layer can fall back to natural language when cached locators become stale.

VS Code Extension for fast authoring and debugging

Shiplight documents a VS Code workflow for debugging *.test.yaml files step-by-step, editing action entities inline, and iterating quickly. It also calls out the CLI install path and API key support for Anthropic and Google models.

Desktop App for local, headed debugging

For teams that want the full Shiplight experience on a local machine, Shiplight offers a Desktop App that runs the full UI locally, supports local headed debugging, and includes a bundled MCP server. The docs list system requirements including macOS on Apple Silicon.

Enterprise considerations: security, reliability, and deployment flexibility

Shiplight’s enterprise materials highlight SOC 2 Type II certification, encryption in transit and at rest, role-based access control, immutable audit logs, and a 99.99% uptime SLA. It also notes private cloud and VPC deployment options, plus integrations across common CI/CD and collaboration tooling.

A simple adoption plan that works in the real world

If you want a rollout that avoids a long QA “platform migration,” use this sequence:

  1. Start with MCP to bring verification into the development loop.
  2. Standardize a few YAML flows for your most valuable user journeys.
  3. Move execution into Shiplight Cloud to get suites, schedules, reporting, and CI gating.
  4. Add the AI SDK where you already have strong Playwright coverage and want to upgrade reliability without rewrites.

Shiplight’s product line is intentionally modular. You can meet teams where they are today, then scale to enterprise-grade operations as coverage becomes mission-critical.