IBM DevOps Test Performance vs. OpenText LoadRunner Professional

Go for IBM RPT if: 1. You're testing a Java-based Web application with HTTP protocol 2. You wanted to distribute the load across machines easily 3. Your team is in learning phase/not really introduced to a wide range of performance testing tools Do not go for IBM RPT if: 1. You wanted to test REST or any other advanced protocols 2. Your system under test demands a very high user load 3. Your application is written in .NET or any other platform except Java.

Incentivized

Micro Focus LoadRunner is good for scripting and running a load test, but should be providing better customer service in case of user facing any issues.

Incentivized

• Data Parameterisation/ Data Correlation is made simpler compared to its competitors
• Distributed Load Testing is easier to set up
• Performance metric gathering while a test is in progress
• Th look and Feel really helps a beginner to understand and work with.

Incentivized

• Support of multiple protocols like HTTP, RDP, Citrix, SAP, Oracle Database 12c, AJAX Tru Client, SOAP-based calls and others which is why it is used widely in our organization as we are using various applications in an industry for different usage.
• Supporting the mobile agents which means it is not only used for web applications but also for mobile applications.
• Latest version of HP LoadRunner makes the scripting easy by replacing dynamic changes in the script using correlation parameters. This means less coding and we can focus on major issues if needed.
• Controller enhancements by specifying the cloud provider like Digital Ocean. We can provision our load generators with Amazon EC2, DigitalOcean and others.
• Analysis provides a nice HTML report on the test executed with all the necessary metrics. We can simply put more analysis if needed and it will be automatically embedded in an HTML report.

Incentivized

• Memory utilization could have been improved.(Eats up system's RAM)! It may crash if a test is conducted with the heavy load if adequate RAM is not available in the VM/host machine.
• Licensing could have been made simpler. IBM's licensing method is difficult to follow.
• Support for protocols other than HTTP. Not really up to the current trend.

Incentivized

• Monitoring tools like SiteScope, AppDynamics should be used apart from HP Performance Center. Would be great if the tool can give good monitoring on app and db servers.
• As the load goes high, the cost increases. In the open source world, it's not a bad idea to consider the licensing cost.

Incentivized

Customer service is not that great. It's difficult to get hold of someone if an issue is supposed to be addressed on an urgent basis. No online chat service readily available.

Incentivized

Cost/Licensing: While JMeter is an opensource testing tool from Apache, compared to IBM RPT and HP LoadRunner, RPT is much cheaper than Loadrunner. Functionality: JMeter provides basic functionalities which are adequate for performance testing, however advanced features are not available (such as load testing with GUI, reporting is very basic etc.). But when it comes to Loadrunner, it offers very broad features and supports a variety of protocols. So in this category, Loadrunner is a winner, but RPT is better than JMeter. Ease of operating: JMeter is easy compared to LoadRunner, but it has old GUI and look and feel is not that great to understand. Also, most of the things are to be done in a command line, non-GUI mode. While LoadRunner is very advanced with many options, which also confusing sometimes. But RPT, on the other hand, maintains a balance between simplicity and offering of different features. So winner: RPT.

Incentivized

Micro Focus LoadRunner fit well into our portfolio of tools with its long track record, ability to test near any application technology we adopt and allow for a single / cohesive toolset to drive our performance testing needs.

Incentivized

• Accuracy in metrics, thus improving system's performance
• Costs less compared to competitor like HP LoadRunner
• Helped the team of beginners learn things quickly

Incentivized

• It has a positive impact as we know how PE testing is (performance).
• It helps with integrating data from various data streams and includes anomaly testing.
• It does a good job with the accuracy of results. The results are very accurate.

Incentivized