Automatically Generate Exhaustive API Tests With TestChimp

When we started TestChimp, our vision was to 10x your QA team by bringing in automation & AI ✨ that works alongside your team.

🚀 Today, we are taking a major step towards that goal: TestChimp can now observe and learn from real test sessions and OpenAPI (swagger) specs to automatically author exhaustive API tests for every endpoint in your system!

What sets us apart? 🕵️‍♂️

1) 📚 Richer data context - learning from real test sessions

There are many attempts at bringing AI automation to QA space, and they differ in terms of the data the AI works on. Some start from the API specs, some take static code etc. TestChimp introduces passive learning by observing the requests occurring in real test sessions (which can be supplemented with API specs to make context richer).

Why this matters:

Real test sessions make for well curated explanations of how the system is expected to work, and vocabularies / variances for each field of each API - without additional documentation overhead.

For instance, consider a login API. A purely spec driven AI generator would come up with "validemail@example.com","validpassword" for a login step - and you need to change to specify valid values after it's created. But learning from real test sessions allows TestChimp to know actual values to use for each field, resulting in tests that actually work.

2) ➡️ Ability to set prior steps to run

API requests tested in isolation are hardly ever useful. Why? Since you need to run prior steps to create the world state that the request operates on. 

Eg: A "checkout" step is meaningless without first running "add_to_cart" 🛒 and most APIs would require a prior authentication step. 

TestChimp allows specifying steps to run before the API under test, resulting in generated tests that are practically useful. 🎉

3) 🗂️ Better organisation with parameterized tests

Test lists can be quite verbose, especially when generated. TestChimp generates 𝑝𝑎𝑟𝑎𝑚𝑒𝑡𝑒𝑟𝑖𝑧𝑒𝑑 𝑡𝑒𝑠𝑡𝑠 rather than individual tests for each permutation, resulting in compact test suites. 

Say the API has 5 different fields. A naive solution would generate 5 tests relating to missing fields: "𝑚𝑖𝑠𝑠𝑖𝑛𝑔_𝑓𝑖𝑒𝑙𝑑𝐴","𝑚𝑖𝑠𝑠𝑖𝑛𝑔_𝑓𝑖𝑒𝑙𝑑𝐵",... and so on. But with parameterization, TestChimp just generates 1 test for the case of "𝑚𝑖𝑠𝑠𝑖𝑛𝑔 𝑓𝑖𝑒𝑙𝑑𝑠" - with different combinations as parameters, resulting in a compact suite. 

4) ✏️ Greater editability of the result

GenAI usually gets things ~80% right, but needs a bit of tweaking. TestChimp generated tests can be loaded in our test studio 🎨 which allows no-code editing, making it seamless to incorporate the generated tests in to your test setup.

#GenAI hashtag#QA hashtag#TestAutomation hashtag#LLM hashtag#DevTools hashtag#GenerativeTests hashtag#APITesting hashtag#ApiTestAutomation