Agent Assisted Test Execution

Agent Assisted
Test Execution

Scripted tests, with Agent step-in on demand. Code comments to drive QA Intelligence

Scripted tests, with Agent step-in on demand. Code comments to drive QA Intelligence

Scripted tests, with Agent step-in on demand. Code comments to drive QA Intelligence

Plain Playwright Scripts

TestChimp's SmartTests are standard Playwright scripts. This means:

TestChimp's SmartTests are standard Playwright scripts. This means:

Run in CI using the Playwright runner you already trust

Run in CI using the Playwright runner you already trust

Run in CI using standard Playwright runner

Fast & Scalable, unlike pure-agentic tests

Fast & Scalable, unlike pure-agentic tests

Fast & Scalable, unlike pure-agentic tests

Maintainable, with no vendor lock-in

Maintainable, with no vendor lock-in

Maintainable, with no vendor lock-in

import { test, expect } from '@playwright/test';
import {ai} from 'ai-wright';
test('userMessagingFlow', async (
	{ page, browser, context }) => {
  
  var url = process.env.BASE_URL;
  var username = process.env.USERNAME;
  await page.goto(url);

  // @Screen: Login
  await page.getByLabel('Email').fill(username);

  await page.getByLabel('Password').fill('...');

  // Click on login button
  await page.getByRole('button').click();

  // @Screen: Dashboard
  await page.getByText('Messages').waitFor();
import { test, expect } from '@playwright/test';
import {ai} from 'ai-wright';
test('userMessagingFlow', async (
	{ page, browser, context }) => {
  
  var url = process.env.BASE_URL;
  var username = process.env.USERNAME;
  await page.goto(url);

  // @Screen: Login
  await page.getByLabel('Email').fill(username);

  await page.getByLabel('Password').fill('...');

  // Click on login button
  await page.getByRole('button').click();

  // @Screen: Dashboard
  await page.getByText('Messages').waitFor();

ai.verify("No error messages");

ai.verify("No error messages");

ai.verify("No error messages");

ai.act("Close cookie modal");

ai.act("Close cookie modal");

ai.act("Close cookie modal");

import { test, expect } from '@playwright/test';
import {ai} from 'ai-wright';
test('userMessagingFlow', async (
	{ page, browser, context }) => {
  
  var url = process.env.BASE_URL;
  var username = process.env.USERNAME;
  await page.goto(url);

  // @Screen: Login
  await page.getByLabel('Email').fill(username);

  await page.getByLabel('Password').fill('...');

  // Click on login button
  await page.getByRole('button').click();

  // @Screen: Dashboard
  await page.getByText('Messages').waitFor();
import { test, expect } from '@playwright/test';
import {ai} from 'ai-wright';
test('userMessagingFlow', async (
	{ page, browser, context }) => {
  
  var url = process.env.BASE_URL;
  var username = process.env.USERNAME;
  await page.goto(url);

  // @Screen: Login
  await page.getByLabel('Email').fill(username);

  await page.getByLabel('Password').fill('...');

  // Click on login button
  await page.getByRole('button').click();

  // @Screen: Dashboard
  await page.getByText('Messages').waitFor();

AI-Native Steps When Needed

Use AI only where scripted steps become brittle with ai.act, ai.verify.

Use AI only where scripted steps become brittle with ai.act, ai.verify.

Use AI only where scripted steps become brittle with ai.act, ai.verify.

Easier authoring for complex flows

Easier authoring for complex flows

Easier authoring for complex flows

Less brittle tests

Less brittle tests

Less brittle tests

Retain the speed of scripts, with agentic flexibility

Retain the speed of scripts, with agentic flexibility

Speed of scripts, with agentic flexibility

QA Intelligence, Driven by Code Comments

QA Intelligence, Driven by Code Comments

QA Intelligence -
Driven by Code Comments


Link to scenarios right from code to enable coverage insights

Link to scenarios right from code to enable coverage insights

Link to scenarios right from code to enable coverage insights

Mark Screens and States for contextual bug reporting by Exploratory Agents

Mark Screens and States for contextual bug reporting by Exploratory Agents

Mark Screens and States for contextual bug reporting by Exploratory Agents

// @Screen: Dashboard

// @Screen: Dashboard

// @Screen: Dashboard

// @Scenario: checkout success

// @Scenario: checkout success

// @Scenario: checkout success

import { test, expect } from '@playwright/test';
import {ai} from 'ai-wright';
test('userMessagingFlow', async (
	{ page, browser, context }) => {
  
  var url = process.env.BASE_URL;
  var username = process.env.USERNAME;
  await page.goto(url);

  // @Screen: Login
  await page.getByLabel('Email').fill(username);

  await page.getByLabel('Password').fill('...');

  // Click on login button
  await page.getByRole('button').click();

  // @Screen: Dashboard
  await page.getByText('Messages').waitFor();
import { test, expect } from '@playwright/test';
import {ai} from 'ai-wright';
test('userMessagingFlow', async (
	{ page, browser, context }) => {
  
  var url = process.env.BASE_URL;
  var username = process.env.USERNAME;
  await page.goto(url);

  // @Screen: Login
  await page.getByLabel('Email').fill(username);

  await page.getByLabel('Password').fill('...');

  // Click on login button
  await page.getByRole('button').click();

  // @Screen: Dashboard
  await page.getByText('Messages').waitFor();
import { test, expect } from '@playwright/test';
import {ai} from 'ai-wright';
test('userMessagingFlow', async (
	{ page, browser, context }) => {
  
  var url = process.env.BASE_URL;
  var username = process.env.USERNAME;
  await page.goto(url);

  // @Screen: Login
  await page.getByLabel('Email').fill(username);

  await page.getByLabel('Password').fill('...');

  // Click on login button
  await page.getByRole('button').click();

  // @Screen: Dashboard
  await page.getByText('Messages').waitFor();

Author with ease

From a plain english scenario

Go from scenario description to executable test in one click

From manual test steps

Record your manual tests with our Chrome Extension to generate automation scripts

Upload existing scripts

Sync your existing playwright test folder or upload your tests directly.

Frequently Asked Questions

How are SmartTests different from plain Playwright scripts?

Traditional scripts can be brittle and flaky for complex interactions. TestChimp augments them with AI-native steps when needed, enabling agent step-in on demand, while keeping tests deterministic and maintainable by being script-first.

Why not rely entirely on agentic testing?

Pure agentic tests are slow (20ms for a script step vs 20s for an agentic step) and non-deterministic, making them not scalable. TestChimp provides a middle ground alternative of including AI-native steps in your existing scripts - retaining maintainability and speed.

How do AI-native steps work inside a test?

Simply say “ai.act(‘do X’)”; The agent steps in, looks at the screen, and decides the action to do based on the english description.

How are executions linked back to test plans?

Each test can reference scenarios in your test plans with a simple comment, allowing execution results, failures, and regressions to map directly back to planned coverage. This removes the need for manually maintained sheets, and makes traceability baked in to the code itself.

How does SmartTests help in Exploratory testing?

Exploratory agents are run using SmartTests as a GPS to guide the agent. This enables controlled navigation, measurable coverage and accurate attribution. // @screen annotations in the code helps agents to tag bugs found aligned with your app structure.

Is this suitable for large, CI-driven test suites?

Yes - SmartTests are just plain Playwright tests, so you can use your existing test runner. AI native step capability is available as an npm library that can be installed so your scripts can continue to run in CI.

Frequently Asked Questions

How are SmartTests different from plain Playwright scripts?

Traditional scripts can be brittle and flaky for complex interactions. TestChimp augments them with AI-native steps when needed, enabling agent step-in on demand, while keeping tests deterministic and maintainable by being script-first.

Why not rely entirely on agentic testing?

Pure agentic tests are slow (20ms for a script step vs 20s for an agentic step) and non-deterministic, making them not scalable. TestChimp provides a middle ground alternative of including AI-native steps in your existing scripts - retaining maintainability and speed.

How do AI-native steps work inside a test?

Simply say “ai.act(‘do X’)”; The agent steps in, looks at the screen, and decides the action to do based on the english description.

How are executions linked back to test plans?

Each test can reference scenarios in your test plans with a simple comment, allowing execution results, failures, and regressions to map directly back to planned coverage. This removes the need for manually maintained sheets, and makes traceability baked in to the code itself.

How does SmartTests help in Exploratory testing?

Exploratory agents are run using SmartTests as a GPS to guide the agent. This enables controlled navigation, measurable coverage and accurate attribution. // @screen annotations in the code helps agents to tag bugs found aligned with your app structure.

Is this suitable for large, CI-driven test suites?

Yes - SmartTests are just plain Playwright tests, so you can use your existing test runner. AI native step capability is available as an npm library that can be installed so your scripts can continue to run in CI.

Frequently Asked Questions

How are SmartTests different from plain scripts?

Traditional scripts can be brittle and flaky for complex interactions. TestChimp augments them with AI-native steps when needed, enabling agent step-in on demand, while keeping tests deterministic and maintainable by being script-first.

Why not rely entirely on agentic testing?

Pure agentic tests are slow (20ms for a script step vs 20s for an agentic step) and non-deterministic, making them not scalable. TestChimp provides a middle ground alternative of including AI-native steps in your existing scripts - retaining maintainability and speed.

How do AI-native steps work inside a test?

Simply say “ai.act(‘do X’)”; The agent steps in, looks at the screen, and decides the action to do based on the english description.

How are executions linked back to test plans?

Each test can reference scenarios in your test plans with a simple comment, allowing execution results, failures, and regressions to map directly back to planned coverage. This removes the need for manually maintained sheets, and makes traceability baked in to the code itself.

How does SmartTests help in Exploratory testing?

Exploratory agents are run using SmartTests as a GPS to guide the agent. This enables controlled navigation, measurable coverage and accurate attribution. // @screen annotations in the code helps agents to tag bugs found aligned with your app structure.

Is this suitable for large, CI-driven test suites?

Yes - SmartTests are just plain Playwright tests, so you can use your existing test runner. AI native step capability is available as an npm library that can be installed so your scripts can continue to run in CI.

Upgrade Your QA Platform Today.

Upgrade Your QA Platform Today.

Upgrade Your QA Platform Today.

TestChimp

QA Platform Purpose Built for Humans and AI Agents

Get In Touch

Email:

contact@testchimp.io

Phone:

+61 434 336 795

Address:

8a Sinfield Street, Ermington, NSW, AU

All Rights Reserved - Aware Labs Pvt Ltd.

TestChimp

QA Platform Purpose Built for Humans and AI Agents

Get In Touch

Email:

contact@testchimp.io

Phone:

+61 434 336 795

Address:

8a Sinfield Street, Ermington, NSW, AU

All Rights Reserved - Aware Labs Pvt Ltd.

TestChimp

QA Platform Purpose Built for Humans and AI Agents

Get In Touch

Email:

contact@testchimp.io

Phone:

+61 434 336 795

Address:

8a Sinfield Street, Ermington, NSW, AU