DeviQA Case Study: CYDEF
DeviQA Logo

Cybersecurity endpoints solution

Our collaboration with a cybersecurity company aimed at improving product quality and increasing release frequency through an efficient QA process.

1.9k+

Test cases added

98%

Test coverage

700+

Automation test scripts created

60%

Reported blocker/critical/
major/minor bugs

2x

Faster regression testing run

4x

Faster new infrastructure creation

About project

CYDEF is a well-known Canadian cybersecurity company that assists businesses globally in safeguarding their computer systems from various security threats.

Their cybersecurity solution, named "Agent" is crafted for efficient threat detection and data breach prevention. CYDEF's method involves identifying all abnormalities, which are then thoroughly examined by their expert team. The goal is to determine whether these anomalies align with known cyber threats. Once a real threat is confirmed, CYDEF promptly implements corresponding preventive measures.

Before DeviQA

  • Non-documented infrastructure creation process

  • 2 weeks to run regression testing

  • 1 month to create the infrastructure for a new client

  • No test cases

  • No automation testing

  • 0% test coverage of the desktop agent

  • Incomplete Bicep template of Azure resources for new infrastructure creation

  • It took up to one month of manual work to create an Azure infrastructure for a client

With DeviQA

  • Fully documented process of new infrastructure creation

  • 4 days to run regression testing

  • <2 weeks to create the infrastructure for a new client

  • >1900 test cases added

  • >700 automated tests added

  • 98% test coverage of the desktop agent

  • Comprehensive Bicep template of all Azure resources

  • Process of new infrastructure creation was partly automated and shortened to one week

DeviQA has helped the company create hundreds of test cases with speed and efficiency. The client regards their workflow as seamless. Importantly, the vendor understands the client's core business value, allowing them to deliver just as expected of them.

Mark Levine

VP Product, CYDEF

Our contribution

Team

1 Manual QA Engineer, 1 Automation QA Engineer, 1 Automation QA/DevOps Engineer

Project length

Since 2020

Technologies and tools

Azure DevOps

Azure Portal

ARM

Bicep

C#

MS Office package

Playwright

TypeScript

Our engagement

DeviQA’s engineers were engaged to optimize the QA process at CYDEF, and their initiatives have brought about substantial improvements.

By creating test cases for the desktop agent and implementing test automation, they’ve elevated product quality and enabled more frequent releases. Regression testing, which used to take 2 weeks, is now completed in just 4 days.

Our team has created a comprehensive test suite comprising over 1900 tests and written over 700 automation scripts, ensuring the robustness of end-to-end testing through cutting-edge automation tools.

The introduction of a Smoke Testing Suite has significantly accelerated the validation of new features, reducing its time by over 75%. By covering 98% of the desktop agent with test cases, our team has contributed to the success of more than 30 releases.

Ops work has played a pivotal role in maintaining the smooth operation of CYDEF's infrastructure. This includes proactive issue detection and swift resolution. Moreover, we've implemented a new streamlined client onboarding process, reducing its time from a month to less than 2 weeks.

Services provided

Web Automation Testing

The DeviQA team developed over 700 automation scripts, which were seamlessly integrated into a continuous integration process. These automation testing scripts have substantially speeded up regression testing.

Web Testing

Our specialists created over 1900 test cases, achieving an impressive 98% test coverage. We've also fully documented the process of creating new infrastructure. Approximately 60% of bugs that we spotted had a Major or higher priority. Thanks to these efforts, we've ensured a stable application state and smooth releases without any unexpected bugs.

Dedicated QA Team

A dedicated QA team, comprising a manual QA engineer, an automation QA engineer, and an automation QA/DevOps engineer, handles manual testing, automation testing, and infrastructure setup. Besides, they are responsible for creating and maintaining all the necessary test documentation.

OPS Services

Our operations services include infrastructure monitoring to make sure everything runs smoothly and address possible issues promptly. We also monitor all client devices in real time to ensure the seamless operation of the CYDEF software. For each new CYDEF client, we establish a distinct Azure infrastructure, always refining and optimizing the process for greater efficiency.

More projects

Test coverage:

90%

  • Web App Testing
  • Test Automation
  • API Testing
  • Dedicated QA Team

Abbott Laboratories

A global healthcare giant relies on DeviQA for end-to-end test automation.

  • 1 day to run regression testing

  • 1 day to run smoke testing

  • 60% increase in the number of regression tests and relevant test cases

  • >1500 automated test scenarios created

Read more

Dev capacity:

+15%

  • Web App Testing
  • Automation Testing
  • E2E Testing
  • Load Testing
  • Mobile Testing
  • API Testing
  • Dedicated QA Team

Compass

DeviQA's team takes full responsibility for testing a real estate solution consisting of a web app and mobile apps.

  • 2 days to run regression testing

  • 10 minutes to run automated E2E testing on each pull request

  • 85% of the application is covered with test cases

Read more

Test coverage:

95%

  • Web App Testing
  • API Testing
  • Dedicated QA Team
  • Mobile Testing
  • Performance Testing

Arklign

Setting up and fine-tuning a holistic QA process for a dental lab management platform.

  • A comprehensive test plan designed

  • 5000+ test cases created for the web app

  • 2000+ test cases created for the mobile apps

  • >20 various devices with different OS, screen resolutions, and browsers used to run regression testing

Read more