DeviQA Case Study: Cognota
DeviQA Logo

Cognota

Guiding a leading provider of LearnOps software in optimizing a test automation strategy.

~130

Tests refactored

~30

Bugs reported

90%

Flakiness rate reduction

20%

Test execution time reduction

70%

Roadmap progress

About project

Cognota, formerly known as Synapse, is the pioneering LearnOps® platform that streamlines L&D processes, such as training intake, project and capacity planning, and content design, allowing learning and development teams to operate with greater efficiency and effectiveness while gaining access to much-needed data.

Cognota turns L&D teams into strategic powerhouses. Its advanced functionality lets companies align L&D strategies, plan learning programs, manage learning experiences, measure learning impact, and optimize LernOps.

Before DeviQA

  • ~120 failures were in a regression test run

  • Static data was leveraged

  • There was no mechanism to clean up the data

  • Static test users were used

  • One environment was supported

  • The test code structure was complex

  • Tests were interconnected

  • Deprecated framework interfaces were used

  • There were duplicated chunks of code

  • UI interactions were leveraged for some actions/entity manipulations

  • Tests were not triggered on a server

With DeviQA

  • 0-1 failure is in a regression test run due to the solid test logic

  • All test data is generated on the fly

  • Mechanisms for data cleaning have been created

  • Dynamic test users are used

  • Local and staging environments are supported

  • The test code structure is clean

  • The tests are independent

  • Up-to-date interfaces are used

  • The code is structured according to the Single Responsibility Principle

  • API functions are leveraged to speed up the process

  • An easy-to-use config is used to trigger regression testing

Our contribution

Team

2 AQA Engineers

Project length

1 year

Technologies and tools

React

Express (Node.js)

Webpack

Jira

Confluence

Cypress

GitHub Actions

Our engagement

Cognota applied to DeviQA for assistance with revamping an automated test suite and integrating a comprehensive automation strategy. The focal point was speeding up the release cadence of the software while enabling the Cognota team to concentrate on platform refactoring and stabilization.

With a robust automated test infrastructure set up by our AQA engineers, the QA process underwent a significant transformation. The execution time of critical regression tests has been slashed, aligning with the overhaul in test strategy outlined in our comparative analysis. Previously cumbersome regression tests, which used to yield around 120 failures, have been streamlined through global test logic refinement, resulting in nearly zero failures.

A regression testing suite now contains a well-structured set of clean automated tests that seamlessly support multiple environments. Designed for rapid test execution and agility, this suite eliminates redundant code and leverages up-to-date interfaces.

By adopting a data-driven approach, DeviQA has introduced unmatched clarity and flexibility to the testing process. Thanks to this paradigm shift, team members can effortlessly comprehend, select, and manage tests as per the evolving demands of the software lifecycle.

DeviQA's expert guidance in test automation has been pivotal for Cognota, allowing its development team to redirect efforts towards core activities such as the refactoring and enhancement of existing functionalities. This strategic reallocation of resources has significantly broadened the scope and efficacy of testing, propelling a surge in product quality and end-user satisfaction.

Services provided

Web Automation Testing

Our automated QA engineers refactored a whole test suite, revised flaky tests, added retry ability, updated old configs and dependencies, and optimized the code structure, making it clean and easy to read. All of these resulted in increased test stability and efficiency and reduced test execution time.

Web Testing

The DeviQA team also dealt with manual testing. To deliver desired results, our engineers manually verified bugs, checked un-automated UI tests, and executed prod testing.

Dedicated QA Team

Our dedicated QA team consisted of 2 automation QA engineers who collaborated closely with the in-house development team and conducted manual, automation, and API testing using Microsoft Architecture. They also diligently created and updated all essential test documentation.

More projects

Test coverage:

90%

  • Web App Testing
  • Test Automation
  • API Testing
  • Dedicated QA Team

Abbott Laboratories

A global healthcare giant relies on DeviQA for end-to-end test automation.

  • 1 day to run regression testing

  • 1 day to run smoke testing

  • 60% increase in the number of regression tests and relevant test cases

  • >1500 automated test scenarios created

Read more

Dev capacity:

+15%

  • Web App Testing
  • Automation Testing
  • E2E Testing
  • Load Testing
  • Mobile Testing
  • API Testing
  • Dedicated QA Team

Compass

DeviQA's team takes full responsibility for testing a real estate solution consisting of a web app and mobile apps.

  • 2 days to run regression testing

  • 10 minutes to run automated E2E testing on each pull request

  • 85% of the application is covered with test cases

Read more

Test coverage:

95%

  • Web App Testing
  • API Testing
  • Dedicated QA Team
  • Mobile Testing
  • Performance Testing

Arklign

Setting up and fine-tuning a holistic QA process for a dental lab management platform.

  • A comprehensive test plan designed

  • 5000+ test cases created for the web app

  • 2000+ test cases created for the mobile apps

  • >20 various devices with different OS, screen resolutions, and browsers used to run regression testing

Read more