Entire test automation for central fraud-detection broken by a technology change and how a major Swiss bank ensured this will never happen again by applying TestResults.io

Challenge

  • Pega updated their technology and broke the entire software test automation with it
  • Depending on software providers through code-based test automation
  • Spares resources for test automation

Solution

  • Automated human-like software test automation (black box testing)
  • Increased flexibility in resources as TestResults.io is easy to use and no certification needed
  • Being compliant with the financial market authority and the enterprise requirements in these regulated surroundings

Result

  • 99% more stable test execution
  • 3 days for the first 2 test cases, each around 50 steps and 20 screens. Without prior knowledge of TestResults.io 
  • 50% faster test executions

The Company

Summary: One of the major Swiss banks and one of the most prominent players in asset management worldwide.

Size: 71'000+ employees

Products: Banking, credit card, financial services

HQ: Switzerland

The Challenge

ENTIRE TEST AUTOMATION WAS BROKEN WITH THE NEW RELEASE OF THEIR PEGA FRAUD-DETECTION SOFTWARE

One of the major Swiss banks, internationally active, uses Pega, a well-known fraud detection software. To enhance the software, the tool provider changed the underlying technology while the user interface remained the same – we assume to make sure no retraining for the employees was required.

This new release broke the entire test automation they had in place. Instead of repairing the whole test automation, they decided to change the tooling to ensure this would never happen again. The switched to a test automation platform for their critical systems which does not depend on the technology of the software under test—especially if it’s not their own software.

The Solution

AUTOMATED HUMAN-LIKE END-TO-END BLACK BOX TESTING

The only way to ensure such updates don’t break the entire test automation is to use a test automation solution that doesn’t rely on the code of the software under test: Human-like black box testing, but automated. In other words, TestResults.io.

As it is so simple and easy to use, they added their apprentices to the software test automation project—with huge success. The flexibility in resources was a great side effect of switching to TestResults.io.

TestResults.io gave them extra confidence as it is built for regulated environments. It supports you in being compliant with the financial market authority and the enterprise requirements in these regulated surroundings.

The Result

99% LESS FLAKINESS THAN WHAT THEY WERE USED TO

While automating the test cases, they were surprised at how much faster they were,even without any experience in TestResults.io. The first two test cases, each around 50 steps with 20 different screens were automated in 3 days—much faster than they were used to. Matter of fact, they were trained experts on their previous tool.

Besides being much faster in test automation than before, they reported having reduced their flakiness by over 99%, as there are no asynchronous processes running in the background which were previously needed. TestResults.io Screen Monitoring and AI wait until the site is loaded and usable. Before, almost 40% of their test runs were flaky, which required a lot of additional resources, which is, by definition, far from the idea of automation.

It’s the most stable test automation solution I’ve ever seen. As you don’t have set waits or additional stability steps, the test execution is up to 50% faster with TestResults.io. 

- Head of Test Services
This is some text inside of a div block.

Get stable test automation without the risk of having the entire automation broken over night

With the human-like, technology-independent software test automation from TestResults.io, you no longer depend on your software provider's technological changes.