How DevOps Transformed Software Testing

Introduction

Aristotle said, “Quality is not an act, it is a habit”. What we can interpret is that quality cannot be a response to a certain situation or something that is faked or postured. Rather quality should be part of a routine; the acts we do on a continuous basis and which should be a reflection of the essential nature of work. This is how today’s IT world is looking at the QA practice.

In a traditional IT world, testing is often seen as separate from the development. They were two distinct entities separated by ideological walls. Thanks to the new trends in IT world, these walls are fast disappearing. One of the major drivers for this transformation is “DevOps”.

Here in this blog, Moin Syed, Associate Director – Advisory & Transformation Services at Cigniti Inc. gives an overview of DevOps, tips for successful DevOps testing and recommendations about testing tools.

What is DevOps

So what is DevOps? It is not a methodology or a suite of tools as many people think. DevOps is a culture that enables seamless coordination among the different stakeholders in the software chain. DevOps brings together the two critical silos of software process namely, development & operations to integrate within the same software cycle.

DevOps drives all the IT stakeholders to collaborate to deliver value faster. For this, it collates the practices of continuous integration, continuous testing, continuous deployment and continuous monitoring.

DevTestOps

As we know DevOps aims to break the barriers between Dev and Ops. It also demands breaking of the barriers between Dev, Test, and Ops. Testing is a critical part of the handoff between development and IT operations. For DevOps to be successful it is mandatory that testing should be fully integrated into the software development and delivery.

With this mindset, everything changes for a traditional testing organization. Testing operations undergo major changes in a DevOps culture. This mandates a shift in tester’s skillset, methods, tools, timing, and approach. DevOps advocates starting test early and constantly.

Some tips for successful DevOps testing:

• Involve development team during test design.
• Identify the critical test cases and prepare the test suite to test the functionality of the required build.
• All the environments required for testing need to be standardized and deployments have to be automated.
• Adopted test-first approaches such as test-driven development (TDD) and behavior-driven development (BDD).
• Keep the test execution cycles short and quick.
• Adopt regression test automation to run across various environments.
• Implement code analysis and coverage tools to ensure 100% code coverage.
• Critical bugs found the need to be reported, fixed and passed through the same chain of events before the code is deployed on to the production environment.
• Encourage parallel execution of tests to help reduce the time for go live which is the heart of a successful DevOps implementation.

Testing maturity is a key differentiator for the success of DevOps. Even if organizations can automate their integrations, builds, and delivery processes but they still struggle to manage test orchestration and automation. Testing brains play a critical role to achieve this with their expertise in test design, test automation and test case development with DevOps.   Irrespective of what DevOps processes, models and tools organizations use, testing is a vital part of the overall DevOps process — not only to ensure code changes work as expected and integrate well — but to ensure the requirement changes do break the functionality.

DevOps Testing Tools

In order to realize the desired business goals of DevOps, it is essential to have right tools to maintain the quality associated with the delivery chain. This calls for accurate and comprehensive testing. So it becomes very important to understand the existing testing process and identify the right testing tools.

Please read the full post – How DevOps Transformed Software Testing and know the testing tools that Moin Syed recommends.