Ranorex Studio vs. ReadyAPI

Although the first year with Ranorex was fine and increased our productivity overall, the first problem that appeared after the standard support period expired gave the whole cooperation a bad taste. Apart from the fact that if you don't buy support continuously and the problem appears after a year and a half, for example, you have to buy support for the whole past period just to get someone to talk to you, after buying support and reporting the problem it took them half a year to even get to the problem analysis during which we were without a working application. Several times we had to tediously report the same problem over and over again as we were shuffled around by support teams who had no continuity for our support case. And when our support expired again for a period during which we could not use the program, Ranorex referred us to another support purchase, still without a working solution. This is totally unacceptable and definitely not a pro-customer approach.

As stated, we do a LOT of API testing, the swaggerhub import makes it easy to add APIs. This is very well-suited, as well as easy management of the steps/cases/suites inside of ReadyAPI. The one thing I do wish ReadyAPI was better suited for is changes to data, we have a lot of test cases in ReadyAPI and if we make a change to how the backend data is structured, one-by-one adjustments need to be made to the steps. Less appropriate, UI testing.

Incentivized

• Initial setup.
• User guide.
• Getting money from customers.

• SoapUI NG Pro is a prefect tool for setting up complicated test cases with many steps including parameterized Web Service requests, response assertions, data generators, data sources, data sinks (report recorders) and more
• You can use Groovy or JavaScript for more complicated automation such as validating the results, extracting data, using external Java libraries or running system processes. Groovy IDE is compatible with Java and you can easily write your code in Java with very few modifications.
• SoapUI enables you to run multiple test suites in parallel or in a loop, and provide user friendly reports including all test case results and test case coverage.
• SoapUI NG Pro lets you to perform security test against your web services with predefined scenarios such as xml bombing, xml injection, sql injection, buffer overflow tests, monkey testing and so on.
• SoapUI NG Pro, offers a simple but practical solution for low to medium load testing scenarios. You can obtain many more Load and Performance testing features by extending your license with purchasing LoadUI Pro.

Incentivized

• Language support is limited, c# and Vb.net only if i remember correctly compared to other tools which allow many more. This addition would certainly be appreciated if added on in a company like mine with a variety of differently skilled individuals
• Paid license. This is not always preferred. A free version without a limited trial but maybe limited features would be appreciated.

Incentivized

• REST - They have come a long way, but there could still be improvements here. I find the learning curve much higher and not as straight forward using REST vs SOAP.
• Composite Projects - I'd really like to see them implement something around saving/refreshing Test Suites when using the Composite project ability in Pro. This is currently an enhancement in feature backlog (see their forum for more details). Functionality around Projects and Test Cases seems pretty sound.

I would definitely renew the ReadyAPI as I was pretty happy while using it. But then I switched my job, and the current workplace is using Postman so we are using it for now. Plus, I don't have any issues with Postman. At the end of the day, it about selecting the tool that gets your work done more efficiently.

Incentivized

SoapUI allows us to combine multiple tests and adhere
to the sequence that they need to run in order to complete successfully.
It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing

Soap UI has managed to continuously build on it's solid foundation and keep improving by each release. It is by far the most dependable and accurate testing tool out there of its kind. Available via connecting to VM's created as SoapUI test machines give access to it anytime, anywhere practically.

It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing.

I suppose my experience is sort of mixed. Help documents are substantially helpful. I personally have not got the quickest responses from Ranorex support but at the same time, they are pretty good with updating their users frequently with info about their product/s and features. The community is really where I find support and I suppose that could look to be an extension of the product itself.

Incentivized

For my purposes, the provided help features have been sufficient. I am sure I would be better off if I were to spend more time studying the app. For now, I load a project, connect, and execute. It just works.

Incentivized

no very easy but lacks documentation

We have used Selenium as well. This has picked up more steam than Ranorex if i have to be honest.

Incentivized

I have not used other API testing products but I am completely satisfied with the functionality and performance of ReadyAPI. It covers all required API protocols and database connections that are used in our organization. It also allows extending the functionality by adding external DB drivers and wiring custom scripts when the native assertion/data manipulation test steps are not sufficient.

Incentivized

It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing. However, I have read that added monitoring tools have been added, which if so the 7 could possibly go to a 8 or 9.

• Reducing testing time is directly saving money if time is considered money.
• Allowing less skilled users the ability to automate testing from the get-go because of Ranorex's ease of use and G.U.I. This of course positively affects a project and assists with user upskilling passively at least.

Incentivized

• We were able to achieve our needs in API test automation with the tool
• In terms ROI, I would say that we have gotten what is basically needed
• Though the initial setup was tough, after that we were able to continue it with user friendly UI and reporting.
• Overall, it had [a] neutral impact in terms [of] ROI.

Incentivized