Azure Test Plans vs. QMetry

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Azure Test Plans
Score 9.1 out of 10
N/A
Azure Test Plans is an exploratory test toolkit available from Microsoft's Azure suite of services. It enables manual testing for users, so that they can plan, execute, and track scripted tests with actionable defects and end-to-end traceability. Assess quality throughout the development lifecycle by testing your desktop or web applications. It is available with Azure DevOps Services.N/A
QMetry
Score 9.0 out of 10
N/A
QMetry is a test management tool that offers test case authoring, reusable test cases, test execution, 140+ reports including deep traceability and test case coverage reports with customization options, and integrations with Jira, CI/CD tools like Bamboo/Jenkins, and Automation frameworks.N/A
Pricing
Azure Test PlansQMetry
Editions & Modules
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
Azure Test PlansQMetry
Free Trial
NoNo
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
Azure Test PlansQMetry
Considered Both Products
Azure Test Plans
Chose Azure Test Plans
I have not used any comparable software to Azure in the same setting. This question does not apply to my review of the software. I have also not encountered any bugs or inadequacies that would prompt us to look into replacing Azure Test Plans as our software of choice for …
Chose Azure Test Plans
It was basically the business decision to use Azure Test Plans as we were moving to Azure from Amazon Cloud Services.
Chose Azure Test Plans
Since we were using Azure DevOps, Test Plans were built-in on the Azure ecosystem the same that we were using to reduce the adoption time and we don't have to install an external tool for this purpose.
Chose Azure Test Plans
Test rail feels quite dated compared to Azure Test plans and Devops as a whole. Functionality and ease of use is actually night and day.
The ability to create structured test plans with ease that can be traced and attached to Epics and stories with relevant tasks allows the …
Chose Azure Test Plans
We're doing a full continuous integration (CI), continuous delivery (CD), continuous testing (CT), security, delivery, and monitoring. They have been lately adding features to the services on a regular basis. Every two weeks, they add functionality to Azure DevOps Services to …
QMetry
Chose QMetry
QMetry provides an easy path for migration from the legacy test management tool. The migration utility is free compared to other vendors. We have received great customer support from day one of the engagement starting with POC, implementation, and ongoing support. Overall, …
Features
Azure Test PlansQMetry
Test Management
Comparison of Test Management features of Product A and Product B
Azure Test Plans
8.4
Ratings
4% above category average
QMetry
9.0
Ratings
11% above category average
Centralized test management8.80 Ratings9.00 Ratings
Manage test hosts and schedules8.20 Ratings8.00 Ratings
Map tests to user stories8.50 Ratings10.00 Ratings
Test execution reporting9.30 Ratings9.00 Ratings
Defect management7.40 Ratings9.00 Ratings
Best Alternatives
Azure Test PlansQMetry
Small Businesses
BrowserStack
BrowserStack
Score 8.6 out of 10
BrowserStack
BrowserStack
Score 8.6 out of 10
Medium-sized Companies
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 8.0 out of 10
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 8.0 out of 10
Enterprises
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 8.0 out of 10
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 8.0 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
Azure Test PlansQMetry
Likelihood to Recommend
9.0
(0 ratings)
9.0
(0 ratings)
User Testimonials
Azure Test PlansQMetry
Likelihood to Recommend
It works well for express test case implementation with a short duration. You can define the tests for two weeks and run the activities documenting the software errors and fixes to control the effectiveness of DevOps. The graphic reports give the idea of the backlog phases advances and errors detected. It needs improvement if you have a large test project and need to design financial budgets and control over costs of the test plan.
Read full review
QMetry, like any new-gen test management tool, works well with any type of development methodologies, be it agile, waterfall or hybrid. It is positioned to be a tool for enterprises of any size. QMetry also provides easy migration of existing test artifacts from a legacy test management tool to QMetry without loss of any information. The one thing that I see as an opportunity for improvement is trying to provide out-of-box integration with all major test automation tools. Another area could be to expand the offering to include it as a product suite with accessibility testing, security testing, performance testing, and test automation which is what the trend is.
Read full review
Pros
  • Integration with Azure Boards
  • Integration with Visual Studio 2022
  • Automation using Pipelines and releases
  • Real time dashboards
  • Integration with code repositories
Read full review
  • Works well with all dev methodologies.
  • Real-time integration with Jira.
  • Out of box reports.
  • Integration with test automation tools.
Read full review
Cons
  • Graphic definition of the the Work Break Down Structure
  • Gantt Chart to check the activity dependance and flow of the process
  • Basic cost module to design test budgets.
Read full review
  • Provision to report on custom fields.
  • Integration with other agile management tools.
  • API limit consumption.
Read full review
Alternatives Considered
Test rail feels quite dated compared to Azure Test plans and Devops as a whole. Functionality and ease of use is actually night and day.
The ability to create structured test plans with ease that can be traced and attached to Epics and stories with relevant tasks allows the system to feel superior in everyway compared to Test rail which had a slow web interface
Read full review
QMetry provides an easy path for migration from the legacy test management tool. The migration utility is free compared to other vendors. We have received great customer support from day one of the engagement starting with POC, implementation, and ongoing support. Overall, pricing and licensing model are affordable and attractive.
Read full review
Return on Investment
  • Typically the sprints themselves and managing the tasks have essentially eliminated our need for reporting.
  • The most valuable features of Microsoft Azure DevOps are high-level protection. Protection is very important to the customers to prevent eavesdropping.
Read full review
  • Helped with overall adoption to the new dev model.
  • Fits well with Devops framework.
  • Overall licensing model is affordable and accommodates many users.
Read full review
ScreenShots