Problem

Our team was tasked with testing a complex data pipeline system for a client. One of the biggest challenges we faced was generating sufficient test data and test cases to ensure that the system would function properly under different scenarios.

We tried various methods, including manual data entry and random data generation, but these approaches were time-consuming, inefficient, and often resulted in incomplete or inaccurate test cases. We needed a more automated and reliable solution.

Learn more about our approach here.

Solution

To address this challenge, we developed a custom tool using LLM (Logical Language for Markup) to generate test data and test cases from user stories.

The tool allowed us to quickly create large volumes of realistic test data based on different scenarios, ensuring comprehensive coverage of the system's functionality. It also enabled us to automatically generate corresponding test cases based on the user stories, reducing the risk of human error and ensuring consistency across all tests.

Impact

Reduced testing time by X%
Increased accuracy and completeness of test cases by X%

"Quote of how incredible of an impact this had."

Team

Team Member #1 - Software Engineer
- Oversaw development of custom LLM tool
- Collaborated with team to ensure tool met client needs
Team Member #2 - Quality Assurance Analyst
- Tested and validated LLM tool functionality
- Created and executed test cases using the tool

Test Data generation using LLM