Mix Plain English Steps in Scripts
No Code Editor - Full Code Power
Create and edit tests visually - without breaking the underlying Playwright
Frequently Asked Questions
How are SmartTests different from plain Playwright scripts?
Traditional scripts can be brittle and flaky for complex interactions. TestChimp augments them with AI-native steps when needed, enabling agent step-in on demand, while keeping tests deterministic and maintainable by being script-first.
Why not rely entirely on agentic testing?
Pure agentic tests are slow (20ms for a script step vs 20s for an agentic step) and non-deterministic, making them not scalable. TestChimp provides a middle ground alternative of including AI-native steps in your existing scripts - retaining maintainability and speed.
How do AI-native steps work inside a test?
Simply say “ai.act(‘do X’)”; The agent steps in, looks at the screen, and decides the action to do based on the english description.
How are executions linked back to test plans?
Each test can reference scenarios in your test plans with a simple comment, allowing execution results, failures, and regressions to map directly back to planned coverage. This removes the need for manually maintained sheets, and makes traceability baked in to the code itself.
How does SmartTests help in Exploratory testing?
Exploratory agents are run using SmartTests as a GPS to guide the agent. This enables controlled navigation, measurable coverage and accurate attribution. // @screen annotations in the code helps agents to tag bugs found aligned with your app structure.
Is this suitable for large, CI-driven test suites?
Yes - SmartTests are just plain Playwright tests, so you can use your existing test runner. AI native step capability is available as an npm library that can be installed so your scripts can continue to run in CI.



