AWS Device Farm vs. SoapUI Open Source, supported by SmartBear

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
AWS Device Farm
Score 8.6 out of 10
N/A
AWS Device Farm is a mobile application performance testing application that provides real-time automated testing and reproduction of issues, simulating and testing issues that may occur on a variety of platforms (e.g. iPhone or Samsung mobile device, or multiple operations systems, etc).
$0.01
per instance minute
SoapUI Open Source
Score 8.6 out of 10
N/A
SoapUI is an open source API testing tool supported by SmartBear's community, supporting functional and performance testing of APIs.N/A
Pricing
AWS Device FarmSoapUI Open Source, supported by SmartBear
Editions & Modules
Pay as You Go - Desktop Browsers
$0.005
per instance minute
Pay-As-You-Go
$0.17
per device minute
Private Devices
$200.00
per month
Unlimited Testing
$250.00
per month
No answers on this topic
Offerings
Pricing Offerings
AWS Device FarmSoapUI Open Source
Free Trial
NoNo
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
AWS Device FarmSoapUI Open Source, supported by SmartBear
Considered Both Products
AWS Device Farm
Chose AWS Device Farm
We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.
SoapUI Open Source
Chose SoapUI Open Source
SoapUI Open Source is free, which is good for light use or simple things here and there. There is a Pro version that makes things more user-friendly. I also like that custom code can also be used for doing more complicated tasks.
I like that SoapUI can have a process/flow …
Chose SoapUI Open Source
Compared to SoapUI, we have been using "light" tools like RestClient extension in Firefox, or Postman.

Compared to Postman, SoapUI is more simple for WSDL / SOAP webservices, as SoapUI generate all envelop, but Postman does not.
Chose SoapUI Open Source
Every application has its own features and UI design but SoapUI is also very good at testing. All features are awesome.
Best Alternatives
AWS Device FarmSoapUI Open Source, supported by SmartBear
Small Businesses
GitLab
GitLab
Score 8.7 out of 10
BrowserStack
BrowserStack
Score 8.6 out of 10
Medium-sized Companies
GitLab
GitLab
Score 8.7 out of 10
ReadyAPI
ReadyAPI
Score 7.0 out of 10
Enterprises
GitLab
GitLab
Score 8.7 out of 10
ReadyAPI
ReadyAPI
Score 7.0 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
AWS Device FarmSoapUI Open Source, supported by SmartBear
Likelihood to Recommend
9.3
(0 ratings)
8.0
(0 ratings)
Support Rating
10.0
(0 ratings)
-
(0 ratings)
User Testimonials
AWS Device FarmSoapUI Open Source, supported by SmartBear
Likelihood to Recommend
As long as you have the right scenarios in mind where you can use AWS Device Farm, you will be very happy. It's a cloud platform for testing automation support, where you can use real devices in multiple configs to validate your Android or iOS use cases. It does easily integrate with your CI pipeline, but reporting and UI are not perfect. A pain point is also the JUnit4 implementation, which could be more mature.
Read full review
If you are making system upgrade project and you have existing system working and you want to imitate messages that are going in production but without making any data loads or switch it’s very suitable and convenient software. It serves well in manual test scenarios but wouldn’t be as good in case of mass tests.
Read full review
Pros
  • Easy testing on many different devices
  • Great integration with development workflow
  • Customizable selection of testing framework
Read full review
  • SOAP
  • REST
  • Authentication
Read full review
Cons
  • Interface (CLI) not very easy. Competition has better options.
  • Integration with IDE for test case coding.
  • Reporting for the test scripts executed.
Read full review
  • I actually like SoapUI as it is, I have not found things to improve, except for the speed of response is very complex services.
Read full review
Support Rating
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
Read full review
No answers on this topic
Alternatives Considered
We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.
Read full review
SoapUI Open Source is free, which is good for light use or simple things here and there. There is a Pro version that makes things more user-friendly. I also like that custom code can also be used for doing more complicated tasks. I like that SoapUI can have a process/flow (conditional/loop/waits/etc.) set up for scripting purposes, which is good for beginners and light users. However, I think the user interface has room for improvement.
Read full review
Return on Investment
  • It impact more and more. Not in terms of ROI but in time as well
Read full review
  • Testing resolves most of the issues in the development phases.
  • User friendliness of the app makes it good.
  • Overall client happiness depends on the clean project, which is possible by testing.
Read full review
ScreenShots