1. Home
    2. /
  2. Case studies
    3. /
  3. SoftNAS

QA for cloud storage solution

DeviQA performed functional, non-functional, API, and automated testing for SoftNAS, creating more than 1,000 automated tests and reaching 80% overall test coverage.

QA for cloud storage solution

Technologies and tools

Python

Selenium

Robot

API

CLI

Jenkins

Linux

Azure

AWS

VMware

NFS

iSCSI

CIFS

DevOps

Team

4 QA engineers

Project length

1 year

About project

SoftNAS is a software-defined cloud network-attached storage (NAS) solution that integrates with Amazon Web Services (AWS), Microsoft Azure, VMware vSphere, and CenturyLink Cloud. The solution supports Network File System (NFS), Common Internet File System and Server Message Block (CIFS/SMB), Internet Small Computer Systems Interface (iSCSI), and Apple Filing Protocol (AFP).

SoftNAS operates as a Linux-based virtual NAS appliance deployed as a virtual machine in hypervisor-based environments. Its software-defined capabilities cover data performance, cost management, high availability, administrative control, backup, and security.

Before DeviQA

  • There was an improperly configured automated testing structure

  • Performance testing was not executed

  • The results of automated test runs were delivered very slowly

  • API testing was not executed

  • QA services and support were insufficient

With DeviQA

  • 25% fewer issues were spotted after the proper implementation of test automation

  • >1,000 test scripts were developed

  • A performance testing suite was created and integrated into a CI process

  • 45% faster delivery of automation test results was achieved

  • A low-level API automation test suite was developed from scratch

  • >200 bugs were reported

  • 30% of logged bugs were critical issues

  • 80% of the app was covered with tests

Our engagement

DeviQA assigned four QA engineers to perform functional, non-functional, API, and automated testing of SoftNAS products.

The team used VMware tooling and the Azure command-line interface (CLI), created test cases, and conducted code reviews. Automated tests with complex input-variable configurations were integrated into Jenkins continuous integration (CI). Multiple test workflows ran in parallel on the CI server. Testing covered CIFS, NFS, and iSCSI storage protocols on Linux and Windows.

The resulting automation suite produced stable test results within the continuous integration pipeline and supported software deployment decisions. The QA engineers created more than 1,000 automated tests. Overall test coverage reached 80% of the application.

Manual testing identified more than 200 defects. Critical and blocker issues accounted for 30% of the reported defects and could have prevented new software releases.

The four QA engineers worked as part of the wider SoftNAS product team throughout the engagement.

Services provided

Services

Web testing

Two QA engineers performed manual testing, verified resolved defects, cleaned up the testing backlog, and created and updated test scenarios. They also coordinated testing activities with the development and QA automation teams.

Facing similar challenges to SoftNAS?

Schedule a call to see how we can help you