TrustRadius: an HG Insights company

Azure Test Plans

Score9.1 out of 10

10 Reviews and Ratings

Get a Demo

What is Azure Test Plans?

Azure Test Plans is an exploratory test toolkit available from Microsoft's Azure suite of services. It enables manual testing for users, so that they can plan, execute, and track scripted tests with actionable defects and end-to-end traceability. Assess quality throughout the development lifecycle by testing your desktop or web applications. It is available with Azure DevOps Services.

Categories & Use Cases

Key Features

Learn about the best (and worst!) features Azure Test Plans has to offer, as determined by TrustRadius' reviewers.
Based on 10 ratings of Azure Test Plans's features
View all features

Top Performing Features

  • Test execution reporting

    Comprehensive reporting on which tests have been run and pass/fail

    Category average: 8.1

  • Centralized test management

    Ability to manages both manual and automated tests from a centralized location

    Category average: 8.6

  • Map tests to user stories

    Provide visibility into user story test coverage

    Category average: 8

Areas for Improvement

  • Manage test hosts and schedules

    Ease of setup of automated tests and test schedules

    Category average: 7.6

  • Defect management

    Ability to automatically log defects and link them to failed tests, and report defect resolution progress

    Category average: 8

Reviews

What users are saying about Azure Test Plans.
View all reviews

Azure Test Plans: SCRUM activities with Backlog follow up after runs.

Incentivized
Fernando RoqueView profile
Statistical Analyst in Engineering at Amplitude & Statistics (1-10 employees employees)

Use Cases and Deployment Scope

Azure Test Plans is an implementation of the SCRUM method to give follow-up of software development (DevOps). We can design the test plans in graphic mode and then Azure TP displays each activity in the backlog divided into different phases. It documents what errors are occurred in each backlog phase to do corrections and rerun the tests until you get a success.

Pros

  • Backlog phases documentation and follow up
  • Scrum method to control de time spent in the test project.
  • Graphic reports to review the number of success and failed runs.

Cons

  • Graphic definition of the the Work Break Down Structure
  • Gantt Chart to check the activity dependance and flow of the process
  • Basic cost module to design test budgets.

Return on Investment

  • Scrum method to difine backlog activities
  • Documentation of test results after each run.
  • Graphic reports in Bar and Circle charts to measure advance of the tests.

Other Software Used

Elasticsearch, Kibana, .NET

One stop Solution - Integrates well with other tools, and enables us to perform different functions within one tool.

Incentivized
Abhishek NandiView profile
Sr. Engineer in Research & Development at GreyOrange (1001-5000 employees employees)

Use Cases and Deployment Scope

Azure Test Plans supports linking bugs and requirements to test cases and test suites. In addition, the following web portal and test-related tools support traceability: View items linked to a test case: View the test plans, test suites, and requirements. They have been lately adding features to the services on a regular basis. Every two weeks, they add functionality to Azure DevOps Services to match it with what Azure DevOps Server or on-prem would offer.

Pros

  • Azure Test Plans provides rich and powerful tools everyone in the team can use to drive quality and collaboration throughout the development process.
  • Browser-based test management solution provides all the capabilities required for planned manual testing, user acceptance testing, exploratory testing, and gathering feedback from stakeholders.

Cons

  • The UI, the user experience, is challenging for newcomers.
  • Project management could be improved.

Return on Investment

  • Typically the sprints themselves and managing the tasks have essentially eliminated our need for reporting.
  • The most valuable features of Microsoft Azure DevOps are high-level protection. Protection is very important to the customers to prevent eavesdropping.

Alternatives Considered

GitLab

Other Software Used

Jira Software, GitLab, GitHub

Azure Test Plans great software

Incentivized
Jason Cooke
Product Support Engineer in Engineering at Therapy Brands (201-500 employees employees)

Use Cases and Deployment Scope

Great value in regression testing our use cases and expected behaviors and outcomes prior to releasing new software. Commonly I spend time with our QA team looking at regression testing results. The visibility from these test cases is highly editable, trackable and collaborative. Azure is easy to work with and as a new user you will feel comfortable within the software rather quickly.

Pros

  • Regression Testing
  • In app test flight
  • Logging of behaviors

Cons

  • continue refining ease of use
  • navigation pane simplified

Return on Investment

  • Streamlined productivity
  • Visibility
  • Defect management

Other Software Used

Microsoft 365, Pluralsight Flow, Zoom

Great test management tool to move to QA automation.

Incentivized
Juan Pablo JonesView profile
Scrum Master in Information Technology at BairesDev (1001-5000 employees employees)

Use Cases and Deployment Scope

We were using spreadsheets to track our manual test cases; we migrate from spreadsheets to this test management tool and then help us to keep control of how many manual test cases we automate. The interface is friendly and has integration with Visual Studio 2022, we were able to tie from end to end our development workflow, from the user stories to the release of those user stories. Technologies utilized were: NuGet, SpecFlow, and Selenium. For our manual tester, it was a really great experience to utilize to start as an automation QA, code using Gherkin structure: Given, When, then It has great integration with Azure boards, pipelines, and releases if you are using Microsoft Azure definitely worth to try it for your project.

Pros

  • Integration with Azure Boards
  • Integration with Visual Studio 2022
  • Automation using Pipelines and releases
  • Real time dashboards
  • Integration with code repositories

Cons

  • More documentation
  • Provide some examples using SpecFlow

Return on Investment

  • Reduce test execution time
  • Improve visibility through its dashboard
  • Increase software quality

Alternatives Considered

QMetry Test Management

Other Software Used

Jira Software, Google Workspace, MURAL

Azure Test Plans - An honest user review

Incentivized
Verified User
Engineer in Engineering (1001-5000 employees employees)

Use Cases and Deployment Scope

We work with a wide range of products and a variety of staff with various skill levels. We required a solution that fit into the companies vision for a uniform seamless and open work environment and compared to the older solution, Microsoft Azure test plans fit somewhat perfectly .Allows employees to have access to any test plan across the wide range of teams, and because we operate as a boundaryless organisation ,having something with these features is vital for the future we want

Pros

  • Multi test plan access
  • Well structured and easy to use
  • Integrates with other azure features to work seamlessly ,connecting the data flow

Cons

  • The UI while easy to use could use more defining area's.Color choice and basic design could use a more obvious facelift as finding certain buttons as a new user might be a challenge
  • Test cases require manual addition into a suite,could be better handled with some form of automation
  • Data tracing while a good feature can often lead you to get confused and lost within the navigation of it all. Can be abit daunting to the new user.

Return on Investment

  • Speed in test creation results in a ROI of time that can be allocated to another task
  • Efficiency that the software allows is positive for speed and quality of software
  • Being able to work with azure devops as a whole creates a unified system for entire company.Linking test plan to a project Epic or story creates great tracking

Other Software Used

Azure DevOps Server, GitKraken, Microsoft Visual Studio Code, Apache JMeter, Atlassian Confluence