AI Driven Testing

Deltix's AI-driven testing service allows developers to assess the usability of their mobile app features for real users without conducting formal research sessions. By running tasks locally against the simulator, the system generates screenshots and records of the agent's interaction, enabling developers to review and replay the process at any time.

To get started, users simply need to verify their email to create an account. The setup involves installing a small native app and signing in with the newly created account. Once logged in, users can write a task in plain English, such as "sign up and send your first message." The agent then attempts to complete the task by interacting with the simulator as a regular user would, all without accessing the app's source code or signing identities.

If a run is ongoing, the agent takes actions based on what it observes on the screen, similar to a typical user. Developers can watch the entire process unfold in real-time or review the screenshots and run records later. If a run is successful, developers can save the task as a Playbook and replay it deterministically on every build, providing a quick pass or fail assessment before conducting more extensive A/B testing in production.

The service supports running tasks on both real iPhone simulators and real iPhones attached to the developer's Mac. Playbooks can be imported from GitHub Actions, GitLab, or CircleCI, and the system is compatible with React Native and Flutter frameworks, treating them the same as native iOS apps.