Sauce Labs vs. Tricentis Testim

Access to specific devices is good, as well as access to a specific browser/platform. We are not able to connect our dev environments to Sauce Labs because the devices are put in our VPC. Some versions are not available like iPhone with iOS 12.1. With iOS, there is limited/no support for push notifications without real devices due to Apple's provisioning profiles.

Incentivized

Well Suited for: Web Application Testing: It excels in automating tests for web applications, including e-commerce websites, CRM systems, and internal web-based tools. Its codeless approach and AI-driven test creation make it suitable for testing various web applications. Regression Testing: It is well-suited for regression testing, where existing test cases need to be executed repeatedly to ensure that new code changes do not introduce defects. Testim's self-healing capabilities help maintain test stability when the application's UI changes frequently. Cross-Browser Testing: Tricentis Testim is an excellent choice for cross-browser testing. It allows organizations to create tests that can be executed across different web browsers, ensuring consistent functionality and user experience. Not suited for: Complex Desktop Applications: Tricentis Testim is primarily designed for web application testing. It may be less appropriate for automating tests of complex desktop applications or applications that do not have a web-based UI. Highly Technical Testing Needs: Organizations with highly technical testing requirements, such as complex API testing or intricate database testing, may find Testim's codeless approach limiting. Specialized testing tools may be more appropriate.

Incentivized

• Gets good people to work for it. These guys and gals are freed and just want you to succeed.
• Sauce Labs listens to what the customers want. (Though I could still use an AWS East-1, hint-hint.)
• They come to us when we ask, so that is pretty cool.

Incentivized

• It provides a codeless testing environment, allowing non-technical users such as business analysts and testers to create and maintain automated tests without writing code. This democratizes test automation and accelerates test creation.
• The platform leverages artificial intelligence (AI) and machine learning (ML) algorithms to analyze user interactions with the application and automatically generate test scripts. This significantly reduces the time and effort required to create test cases.
• Its AI capabilities enable tests to adapt to changes in the application's user interface (UI) automatically. If UI elements change, the platform can identify and update the tests accordingly, reducing maintenance overhead.

Incentivized

• Cost: it's a little bit pricey, but I don't pay the bill so I'm not complaining too much there. Overall, I'd say the price isn't ridiculous but it's not inexpensive.
• Logs: I don't find their logs very useful for front-end web tests, I usually refer to my own logs if I have a bug/issue/error that needs investigation.

Incentivized

• Providing more comprehensive reporting and analytics capabilities, including customizable dashboards and insights into test execution results, could help users gain deeper insights into their test coverage and quality.
• Expanding integration capabilities with a wider range of external systems, tools, and test management platforms could increase flexibility and interoperability within the testing ecosystem.
• Enhancements in organizing and managing test scenarios and test suites could improve the user experience. Features such as better folder structures, tags, and hierarchical organization could make it easier to manage large test suites.

Incentivized

I love how it's super easy to use. Not only that but it ensures security and it always has great updates to ensure that it continues to be awesome. Also, I love how nice the people there are too. Their support tea is amazing. Anytime, I have a question, they are super speedy to answer.

Incentivized

I think Sauce Labs is great and I've been using them since late 2014. With that said, I'm very used to how their interface works and how to get what I need. I think if a brand new user would come in and use it, it would still be easy, but maybe not as easy as it is for me. That's why I rate this area a 9 instead of a 10. Still great though!

Incentivized

We are using Testim all the time. Every new, big we roll out feature has tests and it is our only tool for regression tests.

Incentivized

Yes, Sauce labs is always there, and it is easy to troubleshoot when you are having any connectivity issue, they always keep you informed when they plan to perform any type of maintenance window on their side in advance, so you can plan and will not affect your current work. I do not recall any outage.

Incentivized

The time where they acquired TestObject and were trying to integrate their services would probably be the most annoying time. Annoying as features were in two separate places (websites) for example. But since the introduction of their unified platform, we haven't run into any issues as of yet and we've used them for at least 5-6 years now.

Incentivized

The support is good for Sauce Labs. It is hard to get an initial response but the support has cleared our issues with Sauce Labs. Sometimes we have to follow up and it's hard to get a hold of the team initially. Once we get a hold of the team, the issues are always resolved.

The customer support is the best I have ever experienced, both personally and in a job role. The chat anytime is a very nice option, there has never been more than a few minute wait to connect with someone, and the agents are very knowledgeable and helpful.

Incentivized

I am not sure if it's my company that makes getting Sauce Labs integrated into the team difficult or is it Sauce Labs. The process for getting Sauce Labs for a project is quite a tedious process and the information for using Sauce Labs initially is quite lacking. There is little support for getting started

Firebase is pay per use and so was difficult to work out the true costings, it also felt more developer focussed whereas Sauce Labs had better Appium support for our Automation team. AWS Device Farm appeared to require either Android or iOS and we wanted both, so that wasn't a great fit. It was also not possible to run Cucumber tests on Android in AWS but this may no longer be the case, but it was another unknown for us and not worth the risk. Sauce Labs explicitly mentioned Cucumber support.

Incentivized

We evaluated several other products, and what gave Tricentis Testim the edge was the ease of use, the customer support and the pricing. While others seemed to have a bit more complex functionality, we have been able to build almost every use case the way we would expect, with very few workarounds.

Incentivized

With private devices, you have full reign over usage of them, so no complaints there. Public devices are available if no one else is using it, which is understandable. Browser VMs are based on number of open sessions and Saucelabs give you a certain number depending on what you need. If you need more, then you pay for more. It is as simple as that. You need more devices, then you can pay for more private ones too. A workaround for public devices is to pick the first available one and not be too picky, that's if you are able to of course.

Incentivized

• Provided an ability for us to run 55,000+ tests/month across all browsers.
• Gave us an opportunity to showcase the great things we have done in quality using Sauce Labs. This was through a white paper and an opportunity to speak at Sauce Con. People in our company have a far better appreciation for the what we do and how far we have progressed in the quality space.

Incentivized

• Tricentis Testim has helped us run a thorough regression daily, something that we were unable to do before
• Tricentis Testim has helped us to catch many seemingly unrelated bugs in a test environment the day of/day after code changes
• Tricentis Testim low code approach has helped us to create automation tests much faster, with more confidence, and allows much easier maintenance

Incentivized