Thank you to everyone who joined us for our recent webinar on Automatic Test Creation with Cypress AI and Studio. During the webinar, we received an enthusiastic set of questions about the capabilities that teams are excited about. Let's walk through some of the biggest themes and questions we heard.
How Test Generation Works
Participants frequently asked about the technology powering Test Generation; specifically how we interpret existing code bases to generate tests with high relevance, accuracy, and correctness.
Automatic Test Creation relies on in-context learning (ICL). ICL is a technique that enables large language models (LLMs) to generate appropriate responses when given the context and examples within their prompt. Essentially, it's an approach that shows the model what to do without retraining or additional fine-tuning. Cypress analyzes your existing test code to contextualize your team's patterns, use of custom commands, and other conventions for the models to generate tests that are consistent with your established conventions.
We use the latest AI models from partners, all of which are hosted securely on our managed Cloud infrastructure, and constantly updated to ensure the best possible performance.
Framework Support and Integration
Many attendees asked whether various frameworks or code patterns would be supported. Today, Test Generation focuses on standard Cypress tests and adapts to custom patterns in your codebase. It effectively recognizes Page Object Models, common testing strategies, manages async state changes, and dynamic UI frameworks like React, Vue, and Angular.
But we're not stopping there; support for additional frameworks and patterns is on our roadmap.
Security, Compliance, and Data Privacy
Cypress' commitment to enterprise-grade security, privacy, and compliance standards extends to and encompasses our AI features.
No training on your data - Our AI models are not trained on customer data.
Zero-day retention - The models used for Automatic Test Creation are hosted securely on our managed Cloud infrastructure. Any information shared with the models is for the sole purpose of providing the feature. Model inputs and outputs are session-bound and not shared with any model provider. Further, our contractual agreements with sub-processors expressly prohibit the retention and use of customer data to train models.
Secure Encryption - Customer data shared with models are encrypted in transit and at rest.
SOC 2 Type 2 - Our security policies, procedures, standards, and controls continuously meet the highest standards, evolving to meet the growing demands in the security and privacy sectors as well as our product growth.
LLM Security & Optimization - We employ a variety of guardrails to assure model safety and performance. This includes, but is not limited to, automated evals, content filters, user feedback loops, human-in-the-loop monitoring, denied topics, and grounding checks. Further, we constantly re-evaluate and update our models to offer the best possible experience to customers.
Feature Controls - Test Generation is an opt-in feature that can be disabled at any time without impacting other Cypress capabilities.
What's Next?
The roadmap questions showed us how excited the community is about Test Generation.
Right now, our focus is on supporting basic Cypress end-to-end test cases, including custom commands.
We know there's demand for Cucumber support, API test generation, component testing, Shadow DOM handling, and more advanced scenarios. While these aren't part of our current focus, we'll be expanding capabilities based on real-world usage and customer feedback. Your input will help shape and determine where we go from here and what comes next.
If there's something specific you'd like to see, we want to hear from you as we build alongside the Cypress community.
How to Get Started
Test Generation is available today as part of UI Coverage, and we're currently enrolling customers in our beta program. If you're interested:
- If you're new to UI Coverage, you can schedule a demo to learn more
- Current UI Coverage customers can reach out to their Cypress Account Executive for beta access
- Enhanced Studio features will be available in open source later in 2025
Join Us on This Journey
The webinar demonstrated how Test Generation can accelerate test coverage without sacrificing quality, ensure consistent testing patterns across teams, and reduce time spent writing repetitive tests. If you missed the webinar, you can watch the recording here.
Your input helps us improve Test Generation. If you're interested in learning more or joining the beta program, you can request a free trial of UI Coverage.
We can't wait to see how you'll use these new capabilities to enhance your testing workflows.