1. Home
    2. /
  2. Case studies
    3. /
  3. Cloud-based email protection software

QA for cybersecurity software platform

DeviQA redesigned the QA process and automated API, UI, and cross-platform testing for the SoleGATE cybersecurity platform developed by Solebit (Mimecast).

QA for cybersecurity software platform

Technologies and tools

Jira

Ruby

Faraday

Cucumber

Linux

REST API

Azure Cloud

Google Cloud

Docker

LCX

Jenkins

RubyMine

Postman

TestRail

Team

4 senior SDETs

Project length

5 years

>150

Autotests developed

6+

Platforms covered

10x

Faster testing time

10

Parallel threads

30

Machines used

500k+

Files uploaded

300+

Bugs reported

200+

Bugs reported by autotests

About project

SoleGATE is a cybersecurity platform developed by Solebit (Mimecast) for detecting threats in uploaded files. The platform was designed to address the speed, cost, and detection limitations of sandboxing, signature-based scanning, and behavioral inspection.

Before DeviQA

  • 20 hours to run regression testing

  • 10% test coverage

  • 1 machine for running tests

  • 1 thread for running tests

  • 1 report for all tests

  • ~15 UI test cases

  • 1 platform was covered by autotests

  • Tests were triggered by a developer manually via a terminal

  • A team stored test results in a large and complicated file

  • The history of test runs was unavailable

  • An unscalable test suite architecture

  • There were no UI tests

  • All test results got lost if some tests failed due to technical reasons

With DeviQA

  • 2 hours to run regression testing

  • 80% test coverage

  • 30 different machines for running autotests

  • 10 threads for running tests on each machine

  • 30 reports with test results of each machine

  • 250+ UI test cases

  • 6+ platforms were covered by autotests

  • Simplified test runs without involving a tech person

  • An efficient reporting system was created to allow the team to view clean reports even if the results contained 10k rows

  • The history of test runs can be easily reviewed in the reporting system

  • Configured file processing selection on several machines (Azure Cloud, Google Cloud)

  • We added >50 e2e UI tests that were triggered automatically after each deployment

  • We simultaneously saved a main test result file and test results of each machine

Yuval Or

Yuval Or

QA manager, Solebit (Mimecast)

“DeviQA automated numerous testing processes to reduce manual effort and resolved file scanning issues. While the build was projected to take 15 hours, they completed it in just three. The team was highly professional, kept detailed records, and maintained an open dialogue and synergistic workflow.“

Our engagement

DeviQA created automated REST API test scenarios using Ruby and the Faraday library. DeviQA built a software development kit (SDK) application that ran across Microsoft Azure, Google Cloud, Docker, and privileged and unprivileged Linux Containers (LXC). The QA team implemented the required integrations using Secure Shell (SSH) and Secure File Transfer Protocol (SFTP) connections. DeviQA designed and developed more than 250 automated tests. The automated test workload uploaded more than 500,000 files for processing.

DeviQA reduced regression testing from 20 hours to 2 hours and enabled test execution without assistance from technical specialists. DeviQA created a reporting system for reviewing test results containing more than 10,000 rows. DeviQA distributed file-processing workloads across multiple machines in Microsoft Azure and Google Cloud.

Services provided

Services

Web testing

DeviQA tested the SoleGATE user interface and created supporting test documentation. The resulting test cases covered 80% of the application. DeviQA created customer-specific test suites for individual software releases.

Facing similar challenges to Mimecast?

Schedule a call to see how we can help you