AWS Device Farm vs. BitBar

As long as you have the right scenarios in mind where you can use AWS Device Farm, you will be very happy. It's a cloud platform for testing automation support, where you can use real devices in multiple configs to validate your Android or iOS use cases. It does easily integrate with your CI pipeline, but reporting and UI are not perfect. A pain point is also the JUnit4 implementation, which could be more mature.

Incentivized

CrossBrowserTesting is a great tool to use when you have a new page or new content that you want to test on an array of devices/browsers. In the diverse online world nowadays, it is nearly impossible to ensure optimization for every case. CBT allows you to get closer to that goal.

Incentivized

• Easy testing on many different devices
• Great integration with development workflow
• Customizable selection of testing framework

Incentivized

• Test Continuously With CI/CD Integrations.
• Selenium and Appium test automation.
• Generate multiple screenshots of the same interface from different devices, operating systems, and browsers at once.
• Run visual comparisons of the same web page on the same browser or mobile device from a previous test session.
• Show layout differences.

• Interface (CLI) not very easy. Competition has better options.
• Integration with IDE for test case coding.
• Reporting for the test scripts executed.

Incentivized

• Test case support is somewhat limited in customization ability.
• Not a unique problem to them (or their 'fault'), but content behind VPN or intranet cannot be scanned.
• Pricing with tier level and features can sometimes be confusing (ie. what is and what is not included).

Incentivized

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Incentivized

We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.

Incentivized

Selenium: 1. Selenium is Open source tool 2. Needs proper framework development and integration with multiple 3rd party tools 3. Not much secure 4. Needs scripting knowledge for people working on it 5. takes time and effort CrossBrowser Testing: 1. Licensed , so secure 2. Less time , less effort 3. Quick results 4. No scripting language knowledge needed 5. More coverage 6. Without any framework creation also we can test on multiple devices/browsers

Incentivized

• It impact more and more. Not in terms of ROI but in time as well

Incentivized

• I would say mostly positive for the service they offer
• Negative is how much time you will need to do this testing

Incentivized