AWS Device Farm vs. OpenText LoadRunner Professional

As long as you have the right scenarios in mind where you can use AWS Device Farm, you will be very happy. It's a cloud platform for testing automation support, where you can use real devices in multiple configs to validate your Android or iOS use cases. It does easily integrate with your CI pipeline, but reporting and UI are not perfect. A pain point is also the JUnit4 implementation, which could be more mature.

Incentivized

Micro Focus LoadRunner is good for scripting and running a load test, but should be providing better customer service in case of user facing any issues.

Incentivized

• Easy testing on many different devices
• Great integration with development workflow
• Customizable selection of testing framework

Incentivized

• Support of multiple protocols like HTTP, RDP, Citrix, SAP, Oracle Database 12c, AJAX Tru Client, SOAP-based calls and others which is why it is used widely in our organization as we are using various applications in an industry for different usage.
• Supporting the mobile agents which means it is not only used for web applications but also for mobile applications.
• Latest version of HP LoadRunner makes the scripting easy by replacing dynamic changes in the script using correlation parameters. This means less coding and we can focus on major issues if needed.
• Controller enhancements by specifying the cloud provider like Digital Ocean. We can provision our load generators with Amazon EC2, DigitalOcean and others.
• Analysis provides a nice HTML report on the test executed with all the necessary metrics. We can simply put more analysis if needed and it will be automatically embedded in an HTML report.

Incentivized

• Interface (CLI) not very easy. Competition has better options.
• Integration with IDE for test case coding.
• Reporting for the test scripts executed.

Incentivized

• Monitoring tools like SiteScope, AppDynamics should be used apart from HP Performance Center. Would be great if the tool can give good monitoring on app and db servers.
• As the load goes high, the cost increases. In the open source world, it's not a bad idea to consider the licensing cost.

Incentivized

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Incentivized

Customer service is not that great. It's difficult to get hold of someone if an issue is supposed to be addressed on an urgent basis. No online chat service readily available.

Incentivized

We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.

Incentivized

Micro Focus LoadRunner fit well into our portfolio of tools with its long track record, ability to test near any application technology we adopt and allow for a single / cohesive toolset to drive our performance testing needs.

Incentivized

• It impact more and more. Not in terms of ROI but in time as well

Incentivized

• It has a positive impact as we know how PE testing is (performance).
• It helps with integrating data from various data streams and includes anomaly testing.
• It does a good job with the accuracy of results. The results are very accurate.

Incentivized