Compass
Project Overview
Before improvement
After improvement
The Challenge
Contactually is a real-estate tool that turns business relationships into results. It is a web-based customer relationship management tool that allows companies to oversee and manage communication activities using an easy-to-use and well-built interface.
Before we joined the project, the team did not have a formal Quality Assurance process. Testing was carried out by the developers, which negatively affected the quality. Moreover, the team didn't make automated testing either for Web or for Mobile. Although the project was at the very initial stage, we have already clearly seen problems that could become critical if they were not eliminated in the early stages.
The good news was that the project had a well-detailed specification. We worked closely with the developers to help them to avoid potential bugs, set up the formal testing process, and do it all in the shortest possible terms because the customer's budget and time frames for the beta was pretty limited.
Due to the fact that DeviQA engineers have experience in similar projects, we were able to do even more than expected.
Achievements
In the early stages of the project, DeviQA team consisted of 1 one full-stack (manual/automation) and one automated QA engineer. The customer allowed us to make any changes in the processes to ensure the quality of the product. So, from now on, the responsibility for the quality is on our shoulders.
As a first thing, we started covering the entire application with test cases using BDD scenarios based on a detailed specification. We made it for several important reasons, namely:
Based on our experience, we chose TestRail as a test case management system. It was done to provide detailed reports to the customer and to have detailed analytics on the number of working and non-working scenarios. The customer was pleased with the results and added one more automation QA from our side.
In the shortest possible time, we made well detailed BDD test cases for smoke, covered them with automated tests, which allowed us to test the basic functionality for ~ 6 mins.
We set up the automatic reports in the TestRail and made autotest support for all main browsers using Browserstack. We run them in parallel(multiple browser instances to speed up the testing process). All automated tests were integrated into the Pipeline process on TravisCI. After each test runs, there was an automatically generated report which was sent to the customer.
Having enough resources, we continued to work on creating additional BDD scenarios for regression. DeviQA created ~ 6k of the well-structured BDD scenarios divided by the 148 sections for regression testing. Because of the right grouping, we always had our scenarios up to date. About 40% of the scenarios for regression testing were Automated.
We run autotests for a smoke before each deploy, and because some of them were built via API, it took ~ 6 mins to run all tests.
Besides, during the manual testing, we have noticed that a good part of the bugs was actual on mobile devices only. We've adapted all main UI automated tests for mobile and run them on the real devices using the Device Farm.
Services Provided
Quick processing of all fixed tickets and close cooperation with the automation team allowed us to avoid major/critical issues on production. Passed hundreds of test runs during regression & smoke testing.
Web App TestingDeviQA team provided mobile testing in parallel with web testing as a good amount of the issues were found on mobile devices. QA checked the app with a range of old and new devices with different versions of OS. Each crash was reported with the logs. Each bug had detailed steps and attachments for quick replication, so additional questions about issues from devs are infrequent events.
Mobile Testing2 Automation QA and 1 Full-stack covered the app with autotests and updated them frequently. Autotest results always helped to find bugs before/after deploys, so new issues were found and reported very quickly. Good test coverage of the main functionality eliminates unexpected issues in production. Parallel autotests run on all supported browsers allowed to exclude bugs related to the specific web environment.
Test AutomationThe dedicated team is the best way to keep your app well tested, maintain communication with the development team fast, and be calm about provided QA services. Three dedicated senior QA engineers were able to build smooth and well-working processes.
Dedicated QA Team