TrustRadius Insights for Optimizely Web Experimentation are summaries of user sentiment data from TrustRadius reviews and, when necessary, third party data sources.
Pros
Ease of Use: Users consistently praise the platform for its elegant and user-friendly design, which enhances productivity across various tasks such as A/B testing.
Reporting: The robust reporting capabilities, multi-account support, and advanced settings have been highlighted to be key strengths provided by the tool by reviewers who value detailed results engine provided by the platform.
Streamlining: Additionally, users commend the intuitive WYSIWYG editor for simplifying editing processes and aiding in thorough live and post-test analysis to streamline experimentation workflows. The ease of experiment setup with metrics tracking features further adds to the platform's appeal and has provided a quick streamlining experience.
Within my organisation I have been mainly leveraging the Optimizely Web Experimentation platform to support our efforts in improving the conversation rate of our selection of products. I've gradually been growing in confidence and exploring the wider features of the tool to make the most of the various features. I started out with more basic experiments to get onboarded with the platform, and quickly found how easy it was to set up multiple variations and segments to narrow the focus. I've had a mix of results across or experiments but I'm constantly learning what works for our audiences and iterating the more familiar I become with the platform. This year is going to be a big focus on our content and webpage structure. I want to ensure I get the right information in front of our customers so they can make informed purchase decisions.
Pros
Clear and simple requirements for each experiment you create
A useful browser plug-in to preview and test experiments prior to publishing
Clear data and analysis tool to share with key stakeholders
Cons
I would love to see more video tutorials for the onboarding as it can be easier to follow along when learning the tools.
Likelihood to Recommend
I have found Optimizely has been really useful to run some quick experiments to validate the approach to changes to the website, exploring multiple options simultaneously to save time and effort prior to making more permanent changes with our development team.
The biggest challenge has been ensure ideas from the wider business have all the necessary criteria to make them a worthwhile experiment. Encouraging stakeholders to create a proper hypothesis for each experiment has helped focus the minds on the outcomes we're expecting. This also makes the analysis easier once we've concluded a test.
VU
Verified User
Employee in Information Technology (51-200 employees)
Currently, we are collaborating on brain storming sessions on how to deliver more specific details to our customers. We pair that with the content management platform so we can connect the better ideas to the existing products we have to, hopefully, create a more diverse product offering then what we currently offer.
Pros
Integrations with third-party APIs
Scaling of content production
Create 1:1 experiences
Cons
More API integrations
Continue enhancing documentation
A larger presence at conferences
Likelihood to Recommend
Designing custom and meaningful 1:1 experiences is one of the best examples I can give where you need to try Optimizely Web Experimentation. The way you can craft your content to very specific use-cases is worth it all alone. If you are looking for a cookie cutter generic tool, this isn't for you.
VU
Verified User
Engineer in Information Technology (201-500 employees)
The product helps us test and optimize how we sell our packages online. Instead of just offering individual products, we want to see if promoting bundled packages performs better. We mainly use A/B testing to compare different versions of pages that lead to our package offerings. We also use personalization to tailor content based on the user’s region, so they see more relevant messaging or offers.
Pros
Reporting
Custom events: Product sales conversion (we can now add now properties)
Great conversion maximization features like CMAB
Stats Accelerator feature is one of the best we've used
Cons
JavaScript is hard to implement sometimes especially for JQuery elements
ROI reporting should be part of the overall experimentation reporting
CMP integration: where we can easily show status of test on the HPT request
CMS integration
More widgets like social proof banners, etc.
Likelihood to Recommend
I have had the opportunity to use Optimizely Web Experimentation before being part of EpiServer then moving to using AB Tasty with is robust editor and ROI reporting to the new Optimizely Web Experimentation platform. Optimizely has gotten a lot better over the years. It is now equipped with great algorithm features and reporting is much robust. I really hope to see their ROI reporting come live and offer great information for my stakeholders.
Optimizely web experimentation is used within our CRO program and to test out site wide changes for typography, buttons, etc. It assists in QA and improving conversion on our pages. It also allows us to implement changes before our development team can create a fully integrated option.
Pros
Quickly develop and start a test
Preview the test changes
Cons
QA different audiences for tests
Anticipate possible traffic for a test
QA a test with other test running
Likelihood to Recommend
Highly suited when you have a team that needs to produce web test quickly and efficiently.
We use Optimizely Web Experimentation platform to do A/B testing for different widgets on our website. Anytime we are working on creating a new page layout, and we are unsure which design/widget/layout is going to be good, experimentation seems to solve the problem. It acts in the same way how google optimize used to work but it is little complex in comparison to that.
Pros
A/B testing
Audience testing
Cons
Graphical user interface of the tool
Complex to use for small use cases
Likelihood to Recommend
The Optimizely Web Experimentation is well suited for scenarios where you want to test out different layouts of a webpage and do A/B testing for certain widgets. It is not good for cases where you have to do multiple testing of different widgets. As although it offers that option but it is super complicated to learn and understand it.
Our organization uses Optimizely Web Experimentation mainly for multivariate testing. It simplifies the major business
problem by addressing conversion rate optimization (CRO).
Utilize this to test different product page variations, landing pages, and checkout flows to
enhance conversion rates and customer engagement. Increased the best-performing
elements, responsible for driving sales, user interactions, and sign-ups by updating content,
CTA, and page design.
Pros
The Platform contains drag-and-drop editor options for creating variations, which ease the A/B tests process, as it does not require any coding or development resources.
Establishing it is so simple that even a non-technical person can do it perfectly.
It provides real-time results and analytics with robust dashboard access through which you can quickly analyze how different variations perform. With this, your team can easily make data-driven decisions Fastly.
Cons
The price for Optimizely may be a bit prohibitive, mainly for smaller businesses or teams. Organizations that are at the scaling phase may not be able to afford it as the experimentation volume grows, so does the cost.
Optimizely performs best with A/B tests, but the multivariate testing functionality becomes somewhat rigid and less intuitive.
Apart from this, it needs to be updated regarding test duration and traffic considerations. For example, longer test durations are required to gather statistically significant results.
Likelihood to Recommend
Best for CRO initiatives, including testing variations of landing pages,
user flows, and product pages. Optimizely may not be suitable for more complex machine
learning models. To analyze the effect of the feature usage the way we will do in our solution. Using the audience to measure the success of the features Also, to the best of my knowledge, Optimizely is the only tool that can do all this.
It is used for A/B testing across all of our web pages for 6+ different channels. It is used to determine implementation for site improvements and I use it daily in my role as a CRO specialist. I launch 3-6 A/B tests per week so I am constantly in Optimizely tracking data for each of my tests and monitoring any temporary fixes that we call a Hotfix that is live on our web pages.
Pros
User friendly
Personalization for the company with testing
Detailed with reporting on each a/b test
Cons
Currently it is slow loading and uploading to the CDN network
Likelihood to Recommend
I love Optimziely and it has personally been my favorite platform to use for web experimentation. It has helped me fully understand testing when it comes to data interpretation due to the fact it is so detailed on the reporting and I appreciate the high level overviews it has when it comes to each tasks listed on the experiments you create.
We present multiple product offerings to our customers, but what order makes the most sense? Should we lead with our most premium product or catch their attention and then have them discover better options? Does the same work for every customer? (Not likely) - this is where web experimentation is helping us.
Pros
A clear understanding of how the test is performing to the main KPI.
Cons
Ability to understand impacts against our more transactional data.
Likelihood to Recommend
For use cases, it's not just about testing one feature against another but also about how some backend logic changes might impact customer behavior.
VU
Verified User
Manager in Product Management (501-1000 employees)
We use Optimizely Web Experimentation as part of our growth and innovation for our digital channels - increasing top of funnel conversion and connecting it to downstream revenue generation impact. We also utilize it on our product org as a design validation and pseudo-feature testing tool. We've got a robust program that delivers 100-150 tests a year and have a high win rate, with testing informing our product roadmap and winning results handed off to product to prioritize and code for production release.
Pros
Powerful Stats Engine that drives conclusivity of outcomes and helps generate trust in results when shared to leadership and stakeholders.
Customizable metrics with various tags, properties, and attributes that allow users flexibility in what and how they architect their Optimizely analytics.
Flexibility for different levels of tech expertise, I live in the tool as an expert JavaScript and front-end developer, someone else might use solely the visual editor to click and make changes without knowledge of how to code.
Cons
The results view is dense and difficult to package easily for leadership, and when filtering by segment it's hard to read comparative outcomes without clearing or swapping filters
The organization of experiments and statuses is a cluttered list and the search is limited in use - would love to see that improve with time
There are so many other MarTech products out there, would love to see more dedicated integrations so we don't have to invest in something like Zapier or Tray to build hacky automations
Likelihood to Recommend
If your org needs to experiment to better validate choices and outcomes but can't invest in development resources and project management then Optimizely Web Experimentation will get you started. Similarly, if you're looking to move fast and flexibly to generate value at speed then Optimizely Web Experimentation is the tool for you.
We have a specific frontend team to build quick experiments on our website. We measure the performance of these experiments, which later help us to take informed decisions about whether they are worth building in our platform. Unfortunately, it is not a straightforward tool for someone without technical knowledge to build these experiments as you still need to know about JavaScript and CSS.
Pros
Fast and reliable.
Ease to use for devs.
Informed decisions.
Cons
Alerts
Likelihood to Recommend
Optimizely Web Experimentation is excellent for companies that want to invest an initial effort in building experiments to validate their hypotheses. I would not recommend this tool for small companies that don't have some development resources to conduct these experiments unless your experiments are simple, like changing colors, texts, or the position of some items.
VU
Verified User
Engineer in Product Management (1001-5000 employees)