AWS Device Farm vs. Visual Studio App Center

As long as you have the right scenarios in mind where you can use AWS Device Farm, you will be very happy. It's a cloud platform for testing automation support, where you can use real devices in multiple configs to validate your Android or iOS use cases. It does easily integrate with your CI pipeline, but reporting and UI are not perfect. A pain point is also the JUnit4 implementation, which could be more mature.

Incentivized

Honestly, it's an all around solution that needs some enhancements. Need to build an app, check! Need to test that app, check! Need to debug that app, check! Visual Studio App Center is a well rounded platform for multiple types of builds and services.

Incentivized

• Easy testing on many different devices
• Great integration with development workflow
• Customizable selection of testing framework

Incentivized

• It supplies the right native integration for test cases both IOS and Android
• Constant device updates means you are working with the right builds to support product use cases
• Excels in automated test cases that are easy to implement, monitor, and digest results

Incentivized

• Interface (CLI) not very easy. Competition has better options.
• Integration with IDE for test case coding.
• Reporting for the test scripts executed.

Incentivized

• Webview support was lacking
• User management seems a bit disconnected from the standard Microsoft ecosystem. Almost feels like you are managing local users and sharing access more than an enterprise solution
• Price could be better
• Buggy on some of the latest versions of windows

Incentivized

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Incentivized

We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.

Incentivized

The biggest benefit is in integrations and plug-ins, as well as the fact that it's not open source. I know open source is popular, but we have all been on the downside of open source and waiting for things to be voted up or a contribution to fix an issue. This alone makes VSAC a nice solution! Plus, it comes with a complete IDE integration of services, documentation, and is light weight

Incentivized

• It impact more and more. Not in terms of ROI but in time as well

Incentivized

• Cut down on time to delivery enhancements and overall builds to users
• Helps test new proposed releases with ease
• Cuts down on local build issues as it does do a good job with local development environments as well

Incentivized