In Case Study

A TEST AUTOMATION HEALTHCARE CASE STUDY

Lines of Selenium code

1,150

Tests built in 6-month

test automation healthcare stat

50%

Shortened release cycles

test automation healthcare stat

5

Projects

When it comes to test automation healthcare companies share similar needs. The digital transformation affected the whole healthcare industry. This transformation increased the demand for test automation. Many healthcare companies such as International SOS, Sanofi, CSS Health, and more, chose TestCraft as their test automation platform. Below we will share how TestCraft enabled one of those companies to scale up its test automation and shorten their release cycles, without restructuring their existing team. This transformation was done while making sure the The Health Insurance Portability and Accountability Act (HIPAA) security regulations were observed.

QA Operation Infrastructure

This specific healthcare company has a large QA operation that spreads over 3 different countries; part of the team is an offshore team and part is an in-house, U.S. based team. The QA operation has a few dozens employees on their team. A small subset of the team members are test engineers and the rest are manual testers. The company has hundreds of apps, directed at different end-users operating in different work environments. They started to work with Selenium, but didn’t manage to scale it correctly, and felt that they spent a lot of time and effort on maintaining the existing Selenium-based, automated, tests.  

The Biggest QA Challenge

The company’s Director of QA approached TestCraft as the development processes were moving more into Agile and DevOps. He desired to find a solution that helped his team keep up with shorter release cycles.

  • I was looking for a solution that would enable us to scale our existing test automation while keeping the same team of manual testers.

Special test automation healthcare Challenges

  1. Secured test automation – HIPAA defines a set of data security regulations all healthcare companies have to comply with. Healthcare companies deal with and store sensitive private data, such as patients medical records. As most QA processes involve real data checks, a certain set of security procedures and precautions must be held to protect this sensitive data. In particular, the customer wanted to ensure:
    1. A secured access procedure to sensitive, private data adhered
    2. Data will not be stored internally, within the QA automation tool, rather will be imported externally from an excel or a database.
  2. Cross browser testing – Due to a huge variety of different apps that have to perform on different locations and browsers, a cross browsing testing that covers all existing options was needed. For example – many health clinics only work with Internet Explorer while others only work with Chrome.
  3. Sync between in-house and offshore testing teams – With the large volume of apps that need to be tested, the QA operation is spread to several teams who are working in different, global locations – a testing team in India, in the Philippines, and an in-house team in the U.S. This presents multiple challenges, while the biggest is the condition to sync between the different teams and have them work with the same tools and share their work and results.
  4. Sync between manual testers and test engineers – The QA team includes 25 people – three of them are test engineers who can code and the rest are manual testers. The Director of QA wanted to empower all the team members and enable them to turn their manual test scenarios – the repetitive ones – into automated ones. He also wanted to enable all the members to work on the same test automation platform, share their work, and be more efficient.
  5. Faster release cycles – The company releases once a month for most of its projects. The move toward Agile and DevOps urges the need of more frequent releases. QA is becoming more of a bottleneck which leaves no other option but to automate regression and continuous testing.

The Test Automation Solution Adopted by The Healthcare Company

The company evaluated a variety of test automation tools. After a POC they concluded that TestCraft fit best to their needs: The 100% codeless solution allows all testers, including manual testers to turn their test scenarios into robust automation. As TestCraft is a SaaS, the different, geographically based teams are able to collaborate while working on the same platform. They can share their test steps and scenarios they create, and reuse and modify each other’s work. All is done in a secured, safe environment that meet the rigorous conditions of HIPAA. TestCraft’s Artificial Intelligence-based maintenance, which overcomes frequent changes in apps, contributes to shortening release cycles as it dramatically reduces maintenance overhead.

  • 100% Codeless with AI-based maintenance – The large team of manual testers can easily automate their test scenarios without coding. Unlike other alternatives they evaluated, TestCraft enables them to not only create the tests without coding but also to codelessly modify the tests upon changes in the app. The unique AI-based maintenance automatically overcomes changes in the apps (changes that should be overcome, with an accuracy level of 97.4%). This enables the company to shorten release cycles time dramatically in a short period without restructuring the existing team.
  • SaaS – Enables offshore and in-house teams to work on the same platform, while sharing each other’s work, and reusing test steps and scenarios.
  • Cross-browser, parallel test executions – TestCraft provides different work environments and browsers they can run tests upon. All these executions can run in parallel to adapt to the frequent release cycles.

  • A secured solution that applies with HIPAA conditions – TestCraft provides secured access, based on a private VPN. In addition, all private, sensitive data is stored externally and is uploaded using an excel file. Read here for some more security measures TestCraft holds to secure our customers’ data and environments.
  • Selenium-based with downloadable code- Selenium is the most common solution used for test automation with a large community of developers around it. Selenium requires coding, framework set up, and is extremely difficult to maintain. TestCraft removes those limitations, and bring out only the very best in Selenium:
    • Zero setup cost
    • Designed for manual testers
    • Dramatically reduced maintenance costs
    • Selenium Bricks
      • Open architecture to leverage the Selenium project
      • Import any open source components
      • Make accessible to manual testers
  • Easy start with a short learning curve – As there is no need to build a framework, the company can begin using TestCraft immediately. TestCraft is designed so that any person, with no technical skills or coding knowledge, will be able to build, run, and maintain the tests.

TestCraft Test Automation Implementation

The company started to implement TestCraft gradually – first, with the U.S. based team. The team selected two of their projects to start with. One of the projects was an app that manages clinic appointments and the other for internal processes management.

Onboarding to TestCraft Test Automation

The team was assigned with an automation expert. The automation expert held a two half-day online tutorial to teach the basics and provide online guidance upon building the initial test scenarios. After the first three days, the team already built their first test scenarios and the basic tests that are reusable for further tests.

  • The online training was a big plus for our team of manual testers. The team had smooth sailing after the 3-day training and saw a tremendous improvement with the release cycles.

TestCraft’s  Test Automation Implementation Results

Within six months, the team managed to cover 1,150 tests in 5 different projects. They shortened their release cycles by 50%. They defined scheduled suites that run 3 times a day on different browsers. They already detected several bugs before production. The release cycle was shortened to two weeks instead of a month in the projects that were automated using TestCraft.

Free Trial

Please register here and start your free trial