DeviQA Case Study: APMMusic.com
DeviQA Logo

APMMusic.com

Our dedicated QA team sets up an efficient QA process, ranging from designing comprehensive test documentation to creating and maintaining automated tests.

>75

E2E tests automated

300+

Critical and major issues reported

1.5k +

Test cases added

200+

Number of released features

Expanded by 100%

Scope of regression tests

About project

APMMusic.com is a platform that offers production music tailored for various media projects. Production music is custom-created and recorded to be used on television, radio, and podcasts, as well as in films, ads, and games. It's typically licensed to media producers who require top-quality and diverse music for their projects.

APMMusic.com boasts an extensive library of over 1 million tracks spanning different genres, themes, moods, and styles. It also houses authentic archival recordings and music representing over 185 countries worldwide. The platform provides straightforward and hassle-free licensing for every track, granting both publishing and master rights.

Media producers turn to APMMusic.com as their primary source of production music, gaining access to top-notch tracks for various media projects. The platform also offers a team of music directors and experts to assist producers in finding the ideal music. Additionally, it provides user-friendly tools and features for easy and convenient music searching, browsing, and downloading.

Before DeviQA

  • >3 hours to execute manual smoke testing

  • ~90% of test cases were outdated

  • No automation testing

  • No load tests

  • ~3 hours to create test data for specific test scenarios

  • No performance testing

  • Smoke testing wasn’t the part of a workflow

  • Redesign product was in development

With DeviQA

  • ~30 minutes to execute automated smoke testing

  • 100% test cases reviewed

  • >900 test cases are up to date and integrated into the workflow

  • >600 test cases updated

  • 75+ E2E automation tests developed

  • 100% of the smoke tests automated

  • 20% of the regression tests automated

  • 2 load test suites implemented

  • 6 thread groups and 104 samplers covered for the current version

  • 6 thread groups and 188 samplers covered for the beta version

  • 2 minutes to create test data for specific test scenarios via JS and Cypress

  • 10+ semi-automated performance tests based on the WebPageTest service

  • 119 deployments followed by automated smoke testing + manual sanity testing for specific cases allowing to catch critical issues in core functionality before they creep into production

  • 6 months to release the beta version, which allowed customers to quickly switch to the new version instead of continuing to use the legacy one

Our contribution

Team

2 Manual QA Engineers, 1 Automation QA Engineer

Project length

Since 2022

Technologies and tools

Jira

Confluence

TestRail

Cypress

Postman

BrowserStack

Google Analytics(GTM)

Salesforce

Lighthouse

WebPageTest

GitHub

Apache JMeter

Our engagement

At the project's outset, there were no established QA processes. The DeviQA engineers took the initiative to create all the necessary initial test documentation. They closely collaborated with a project manager to define the ticket flow for the redesign project and testing procedures. In about three months, the initial test documentation was successfully developed, forming a strong foundation for subsequent stages of the redesign project.

Then, an initial test suite was created in TestRail. It included around 1,000 test cases for features with approved requirements.

Recently, we have introduced test automation using Cypress, which is highly effective for smoke tests and a portion of regression tests. These automated tests comprise 75% of all automated test cases and speed up the smoke testing process by threefold.

Test automation brought substantial value to Application Performance Management (APM) efforts. It streamlined testing processes and gave the manual QA team more time for testing new features, creating test cases, and maintaining existing ones. This increased capacity enabled faster delivery of new functionalities and bug fixing, reducing the time needed to progress from the testing environment to production deployment by 2-3 times.

The DeviQA team also successfully implemented two load test suites—one for the legacy website with 104 samplers and another one for the redesigned website with 188 samplers. These suites were organized into six-thread groups based on functionality, aligning with the target actions per hour. These load tests enabled the client to identify and address issues that could affect the website's performance, speed, or usability under heavy loads. Additionally, results from these tests were compared with the performance of the live production website to ensure a seamless transition to the redesigned website upon its completion.

The efforts of the DeviQA team have streamlined the QA process, enabling the detection and elimination of unexpected bugs.

Services provided

Test Automation

The DeviQA team used Cypress to comprehensively cover the core app functionality with automated tests. These tests encompass 75 E2E scenarios, ensuring thorough validation of all user-interaction points. Furthermore, we have seamlessly integrated our testing suite with the Cypress Cloud solution for enhanced reporting and statistical analysis. To improve flexibility, we have configured the suite to run effortlessly across all available environments within the redesign project, eliminating the need for additional configurations. In addition, we have thoughtfully provided clear instructions for the QA team, enabling every team member to easily execute tests on their own machines, promoting efficiency and collaboration.

Load Testing

Our team has successfully implemented load test suites for the legacy and redesigned websites, utilizing usage analytics data provided by our customers. These load tests have been thoughtfully configured to simulate a comparable load aligned with the average statistical actions such as playlist creation and track playback per hour.

We meticulously collect results of load testing in both HTML and CSV formats. This data enables us to quantitatively measure and compare the stability and APDEX (Application Performance Index) of both websites, facilitating informed decision-making and performance optimization.

Performance Testing

Our QA engineers carry out performance testing, recognizing its vital role in the software development lifecycle. This essential step allows us to pinpoint and rectify performance-related issues before deploying the application to production.

Our primary objectives are bottleneck identification, user experience improvement, downtime minimization, and failure reduction. By achieving these goals, we guarantee that the application maintains its speed, scalability, reliability, and efficiency, ultimately delivering a superior product to our users.

Web Testing

The DeviQA team has achieved a comprehensive test coverage by thoroughly testing various vital and critical components of the application. Approximately 80% of the app functionality is covered with test cases as of now.

Through meticulous usability testing and feedback analysis, we successfully identify and address user interface issues. Additionally, the execution of load testing lets us achieve a significant reduction in load times, thereby enhancing the overall performance of the application.

To safeguard against unexpected issues, we have expanded our regression testing suite and introduced partial automation, guaranteeing bug-free releases and a high level of software quality.

Dedicated QA Team

The DeviQA team is an integral part of the client's in-house QA team. Our two manual testers and one automation tester are responsible for feature verification, maintenance of both manual and automated test suites, test documentation creation, and execution of load and performance tests.

Our step-by-step improvements have allowed the project to seamlessly and rapidly deliver new features.

The development team is primarily based in the US time zones, and our QA team covers a wider range of working hours due to being based in Eastern Europe. This allows us to safely deploy new releases and validate them when app users are inactive, minimizing disruption and ensuring a smooth user experience.

More projects

Test coverage:

90%

  • Web App Testing
  • Test Automation
  • API Testing
  • Dedicated QA Team

Abbott Laboratories

A global healthcare giant relies on DeviQA for end-to-end test automation.

  • 4 days to run regression testing

  • 1 day to run smoke testing

  • 60% increase in the number of regression tests and relevant test cases

  • >1500 automated test scenarios created

Read more

Dev capacity:

+15%

  • Web App Testing
  • Automation Testing
  • E2E Testing
  • Load Testing
  • Mobile Testing
  • API Testing
  • Dedicated QA Team

Compass

DeviQA's team takes full responsibility for testing a real estate solution consisting of a web app and mobile apps.

  • 2 days to run regression testing

  • 10 minutes to run automated E2E testing on each pull request

  • 85% of the application is covered with test cases

Read more

Test coverage:

95%

  • Web App Testing
  • API Testing
  • Dedicated QA Team
  • Mobile Testing
  • Performance Testing

Arklign

Setting up and fine-tuning a holistic QA process for a dental lab management platform.

  • A comprehensive test plan designed

  • 5000+ test cases created for the web app

  • 2000+ test cases created for the mobile apps

  • >20 various devices with different OS, screen resolutions, and browsers used to run regression testing

Read more

Elevate your software quality with our cutting-edge QA solutions.

Don’t let software bugs and performance issues jeopardize your reputation. Surpass your competitors with our specialized data-driven QA solutions that ensure detection and rectification of up to 95% of potential issues. Enter your business email below for a free Proof of Concept to start enhancing your software reliability today.