Summary

Siemens Healthineers’ Customer Enterprise Services team was looking to improve on lengthy testing processes. After piloting Harness’s AI Test Automation product on their enterprise workforce-solutions project, they slashed test-creation time, simplified maintenance, and empowered testers to automate complex web workflows.

Introduction

Siemens Healthineers’ Customer Enterprise Services has a fast release cadence. Given the high velocity of feature development required, the QA team was looking to automate their QA process as much as possible. The goal is to make the testing process as fast as possible for the release process, and they can reinvest the saved time (with test automation) to design and create more test cases.

Challenges for the QA team

Initially, the QA team used manual testing alongside early Selenium setups, which involved extensive configuration and debugging. Hence, the QA team wanted to prioritize automation initiatives to enhance feature validation efficiency.

Solution: AI-powered Test Automation

Siemens Healthineers conducted a proof of concept (POC) of Harness AI Test Automation, which leverages a no-code approach, AI-driven test generation, auto-assertions, and live-edit debugging features.

The key aspects of the implementation included:

• Half-day setup for AI Test Automation versus multiple days for Selenium.
• Task-based recording that captured entire workflows across browser, reducing manual scripting.
• NLP-powered prompts to generate multi-step validations automatically, minimizing manual assertion authoring.
• Step-level failure reports with screenshots and logs, enabling edits directly in the browser for rapid maintenance.
  

“We could just see in the browser exactly where it went wrong and directly edit that step. That was really fast and quick.” - Amrita Majumder, Lead QA Engineer, Siemens Healthineers.

Results

• Test-creation and setup time fell from multiple days per scenario in Selenium to under an hour using AI Test Automation.
• Debugging and maintenance cycles dropped from hours to minutes thanks to live-edit fixes and clear failure visibility.
• Initial AI Test Automation tests have been onboarded across multiple projects, with plans to extend coverage portfolio-wide.
  

Future Plans and KPIs

Siemens Healthineers will track two primary KPIs to quantify productivity gains with AI Test Automation:

• Reduction in release timelines, aiming to compress or maintain monthly releases with higher confidence.
• Redeployment of saved testing effort into delivering additional planned features each cycle, boosting overall feature throughput.
  

By meeting these objectives, the Customer Enterprise Services team expects to sustain rapid innovation while maintaining robust quality across its workforce-solutions offerings.