Siemens Healthineers' QA team ran a proof of concept with Harness AI Test Automation to overcome lengthy testing processes blocking release velocity. The solution leveraged no-code AI-driven test generation with auto-assertions and live-edit debugging, dramatically cutting both setup time and test creation time. Time savings are being reinvested into designing more comprehensive test cases, with plans to extend coverage portfolio-wide.
Summary
Siemens Healthineers’ Customer Enterprise Services team was looking to improve on lengthy testing processes. After piloting Harness’s AI Test Automation product on their enterprise workforce-solutions project, they slashed test-creation time, simplified maintenance, and empowered testers to automate complex web workflows.
Introduction
Siemens Healthineers’ Customer Enterprise Services has a fast release cadence. Given the high velocity of feature development required, the QA team was looking to automate their QA process as much as possible. The goal is to make the testing process as fast as possible for the release process, and they can reinvest the saved time (with test automation) to design and create more test cases.
Challenges for the QA team
Initially, the QA team used manual testing alongside early Selenium setups, which involved extensive configuration and debugging. Hence, the QA team wanted to prioritize automation initiatives to enhance feature validation efficiency.
Solution: AI-powered Test Automation
Siemens Healthineers conducted a proof of concept (POC) of Harness AI Test Automation, which leverages a no-code approach, AI-driven test generation, auto-assertions, and live-edit debugging features.
The key aspects of the implementation included:
- Half-day setup for AI Test Automation versus multiple days for Selenium.
- Task-based recording that captured entire workflows across browser, reducing manual scripting.
- NLP-powered prompts to generate multi-step validations automatically, minimizing manual assertion authoring.
- Step-level failure reports with screenshots and logs, enabling edits directly in the browser for rapid maintenance.
Results
- Test-creation and setup time fell from multiple days per scenario in Selenium to under an hour using AI Test Automation.
- Debugging and maintenance cycles dropped from hours to minutes thanks to live-edit fixes and clear failure visibility.
- Initial AI Test Automation tests have been onboarded across multiple projects, with plans to extend coverage portfolio-wide.
Future Plans and KPIs
Siemens Healthineers will track two primary KPIs to quantify productivity gains with AI Test Automation:
- Reduction in release timelines, aiming to compress or maintain monthly releases with higher confidence.
- Redeployment of saved testing effort into delivering additional planned features each cycle, boosting overall feature throughput.
By meeting these objectives, the Customer Enterprise Services team expects to sustain rapid innovation while maintaining robust quality across its workforce-solutions offerings.
