TrustRadius: an HG Insights company

AWS Device Farm

Score8.6 out of 10

11 Reviews and Ratings

What is AWS Device Farm?

AWS Device Farm is a mobile application performance testing application that provides real-time automated testing and reproduction of issues, simulating and testing issues that may occur on a variety of platforms (e.g. iPhone or Samsung mobile device, or multiple operations systems, etc).

Categories & Use Cases

For Automated Testing AWS Device Farm is awesome

Pros

  • Automated testing work well
  • We are able to use like real devices that our customers might be use
  • And within our own test, we can run the test so we can get to know all scenarios that we also know

Cons

  • To be Frank, I have not found any room where it needs to improve. As whatever we used, It is useful for us

Most Important Features

  • Multiple browser testing
  • Automated testing with well known frameworks
  • Logging mechanism for error tracking

Return on Investment

  • It impact more and more. Not in terms of ROI but in time as well

Alternatives Considered

AWS Cloud9

Other Software Used

AWS CodeCommit, Amazon Lightsail, DigitalOcean Droplets, Google Cloud CDN

AWS Device Farm is Perfect for Testing Mobile Apps Quickly on Any Device Imaginable!

Pros

  • Easy testing on many different devices
  • Great integration with development workflow
  • Customizable selection of testing framework

Cons

  • Could always use a cleaner UI

Most Important Features

  • A large number of devices to choose from
  • Versatile test configuration
  • Integration with Selenium

Return on Investment

  • Quicker testing leads to faster product to market times
  • Can deploy updates much more regularly by testing across many devices quickly

Other Software Used

Google Cloud Pub/Sub, LinkedIn Jobs, LinkedIn Premium Career, Quizlet, WileyPLUS

Using real devices to run E2E mobile testing on Android and iOS, integrated with our CI pipeline!

Pros

  • 100% compatibility with the installed user base. No simulation, but real results.
  • Integration with Jenkins and other CI/CD tools.
  • A considerable amount of device types available. Again, real devices in the cloud!

Cons

  • Interface (CLI) not very easy. Competition has better options.
  • Integration with IDE for test case coding.
  • Reporting for the test scripts executed.

Return on Investment

  • Reduced the amount we spent on physical devices by > 90%.
  • Enabled real CI integration even when running E2E test scripts using mobile phones.
  • Helped us to improve overall App stability and rating - fewer crashes (80% to 99% of sessions crashless) and 75% rating increases on apps.

Other Software Used

Snowflake, Firebase Crashlytics, AWS IoT, IBM Watson IoT, Azure IoT