In Case Study

A TEST AUTOMATION HEALTHCARE CASE STUDY

TestCraft Healthcare Case Study

Lines of Selenium code

1,150

Tests built in 6 months

test automation healthcare stat

50%

Shortened release cycles

test automation healthcare stat

5

Projects

Highlight:

  • The digital transformation of the healthcare industry created a major increase in demand for test automation to keep up with shorter release cycles.
  • Many healthcare companies such as International SOS, Sanofi, and CSS Health use TestCraft as their test automation platform to meet these business needs, all without restructuring their existing teams.
  • A Director of QA successfully scaled up his company’s test automation within six months of implementing TestCraft, shortening release cycles by 50% while maintaining HIPAA compliance throughout.
  • I was looking for a solution that would enable us to scale our existing test automation while keeping the same team of manual testers.

The Challenges:

This Director of QA oversees dozens of web applications, directed at different end-users operating in a wide range of work environments. To test and monitor these apps, he manages a QA team of a few dozen employees spread over 3 different countries, split between offshore and in-house, US-based teams.

While a small subset of the team members includes test engineers who can code, the rest are manual, business testers who spend an inordinate amount of time working on repetitive manual test case scenarios. The QA team started to work with Selenium to automate these processes, but they didn’t manage to scale it correctly and felt that they spent a lot of time and effort on maintaining existing Selenium-based automated tests, rather than creating new tests for new features.

As the company’s development processes moved further towards agile and DevOps, the Director of QA took action and searched for a solution that would help his team operate more efficiently and shorten their release cycles. Since only a small number of employees on the QA team knows how to code, he wanted to enable all the members to work on the same codeless test automation platform where they could share their work, regardless of skill or location.

In addition, this tool needed to have cross-browser testing capabilities to cover applications that perform on both different locations and browsers. As an example, many health clinics only work with Internet Explorer while others only work with Chrome.

Lastly, the tool needed to be secure enough to comply with HIPAA regulations. As most QA processes involve real data for created checks, the customer wanted to ensure that the tool is secure and data handling is compliant.

The Solution:

After conducting a proof-of-concept (POC) for a few alternative solutions, this healthcare company decided that TestCraft was the test automation tool that best fit their needs. While they already had Selenium set up in their environment, they needed a tool that could complement their existing Selenium framework, allow for easier maintenance and be accessible to all members of their QA team.

Utilizing TestCraft’s 100% codeless test automation platform, the company’s large team of manual testers could easily automate Selenium-based test case scenarios without the technical knowledge that Selenium requires. Since there is no need to build a framework from scratch, the company was able to build, run and maintain tests almost immediately when they started using TestCraft.

Unlike other alternatives they evaluated, the company was also impressed by TestCraft’s AI-based maintenance feature, which automatically modifies tests to overcome changes in the app with an accuracy level of over 95%. This kept their tests from breaking, freeing up time to build and run new tests instead of maintaining existing ones. This enabled the company to shorten release cycles time dramatically in a short period of time without restructuring the existing team.

As a SaaS solution, TestCraft was also ideal for supporting the company’s agile and DevOps processes. The company could simply roll out TestCraft across all three of their teams, which offered a platform for them to easily share their test steps and scenarios they created, as well as reuse and modify each other’s work. Using TestCraft, each team could also run cross-browser test executions in parallel to adapt to the frequent release cycles.

Lastly, they could do this all in a secure environment that meets HIPAA’s rigorous conditions. TestCraft provides secure access, based on a private VPN, and all private or sensitive data can be stored externally and only uploaded on-demand.

Example of TestCraft test flows for a healthcare application

Results:

This company started to implement TestCraft gradually, starting with the US-based team and later expanding to the other two locations. They selected two projects to start with: an application that manages clinic appointments and another for internal processes management.

  • The online training was a big plus for our team of manual testers. The team had smooth sailing after the 3-day training and saw a tremendous improvement with the release cycles.

Within six months, the company shortened its release cycles by 50% (down to two weeks instead of a month), covering 1,150 tests across five different projects. They defined scheduled suites that run 3 times a day on different browsers and already detected critical bugs before releasing to production.

Example TestCraft test automation dashboard for the healthcare company

Free Trial

Please register here and start your free trial