AWS Device Farm vs. BlazeMeter

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
AWS Device Farm
Score 8.6 out of 10
N/A
AWS Device Farm is a mobile application performance testing application that provides real-time automated testing and reproduction of issues, simulating and testing issues that may occur on a variety of platforms (e.g. iPhone or Samsung mobile device, or multiple operations systems, etc).
$0.01
per instance minute
BlazeMeter
Score 8.1 out of 10
N/A
The BlazeMeter Continuous Testing Platform is a unified, end-to-end, next-generation software test automation platform built for both Agile and COE teams, from Perforce. BlazeMeter includes complete continuous testing capabilities deeply integrated into a single, intuitive workflow.
$149
per month
Pricing
AWS Device FarmBlazeMeter
Editions & Modules
Pay as You Go - Desktop Browsers
$0.005
per instance minute
Pay-As-You-Go
$0.17
per device minute
Private Devices
$200.00
per month
Unlimited Testing
$250.00
per month
Basic
$149.00
per month
Pro
$649.00
per month
Offerings
Pricing Offerings
AWS Device FarmBlazeMeter
Free Trial
NoNo
Free/Freemium Version
NoYes
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
AWS Device FarmBlazeMeter
Considered Both Products
AWS Device Farm
Chose AWS Device Farm
We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.
BlazeMeter
Chose BlazeMeter
BlazeMeter scores well against Apache JMeter in one Key point , the load generation from different cloud based systems. This helps to measure the capacity of the the application in a transparent way and not bogged down by the capacity of the system from where the test is …
Chose BlazeMeter
In comparison with Blazemeter the closes competitor is JMeter but it has disadvantages like it is not a tool that can be use as a collaborative tool and works locally in a computer, Blazemeter is in the web so different people can access and run tests or collaborate do add, …
Chose BlazeMeter
BlazeMeter integrates better with a continuous delivery pipeline than SOASTA did.
Chose BlazeMeter
Personally, I prefer using JMeter + Redline13, however we had some business folks that wanted to be able to run a few of their own tests. The non-technical individuals preferred to use Blazemeter because of its simple and intuitive UI.
Best Alternatives
AWS Device FarmBlazeMeter
Small Businesses
GitLab
GitLab
Score 8.7 out of 10
BrowserStack
BrowserStack
Score 8.6 out of 10
Medium-sized Companies
GitLab
GitLab
Score 8.7 out of 10
ReadyAPI
ReadyAPI
Score 7.0 out of 10
Enterprises
GitLab
GitLab
Score 8.7 out of 10
ignio AIOps
ignio AIOps
Score 8.1 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
AWS Device FarmBlazeMeter
Likelihood to Recommend
9.3
(0 ratings)
9.0
(0 ratings)
Support Rating
10.0
(0 ratings)
-
(0 ratings)
User Testimonials
AWS Device FarmBlazeMeter
Likelihood to Recommend
As long as you have the right scenarios in mind where you can use AWS Device Farm, you will be very happy. It's a cloud platform for testing automation support, where you can use real devices in multiple configs to validate your Android or iOS use cases. It does easily integrate with your CI pipeline, but reporting and UI are not perfect. A pain point is also the JUnit4 implementation, which could be more mature.
Read full review
It is good for measurements of performance testing. It can be used to run API testing. I can not use this for monitoring but it can be used as a complement for monitoring tools (like Catchpoint or New Relic). It can help to produce load on your site and monitor.
Read full review
Pros
  • Easy testing on many different devices
  • Great integration with development workflow
  • Customizable selection of testing framework
Read full review
  • Blazemeter has very intuitive and uncluttered UI. It is very easy for a beginner to figure out and get started.
  • Blazemeter allows several methods of creating performance tests - using several popular open source applications. Therefore most often there is no need to learn to use a new tool or language.
Read full review
Cons
  • Interface (CLI) not very easy. Competition has better options.
  • Integration with IDE for test case coding.
  • Reporting for the test scripts executed.
Read full review
  • It required good knowledge to analyze BlazeMeter report.
Read full review
Support Rating
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
Read full review
No answers on this topic
Alternatives Considered
We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.
Read full review
BlazeMeter scores well against Apache JMeter in one Key point , the load generation from different cloud based systems. This helps to measure the capacity of the the application in a transparent way and not bogged down by the capacity of the system from where the test is executed (in this case Apache JMeter)
Read full review
Return on Investment
  • It impact more and more. Not in terms of ROI but in time as well
Read full review
  • BlazeMerter helped performance tests run on their cloud, thereby diminishing our on-prem setup costs tremendously.
  • BlazeMeter pings our application from several geographical locations, thereby simulating real life users.
  • BlazeMeter offers dedicated IPs so that firewall issues can be bypassed.
Read full review
ScreenShots