Optimizely Web Experimentation vs. VWO

I think it can serve the whole spectrum of experiences from people who are just getting used to web experimentation. It's really easy to pick up and use. If you're more experienced then it works well because it just gets out of the way and lets you really focus on the experimentation side of things. So yeah, strongly recommend. I think it is well suited both to small businesses and large enterprises as well. I think it's got a really low barrier to entry. It's very easy to integrate on your website and get results quickly. Likewise, if you are a big business, it's incrementally adoptable, so you can start out with one component of optimizing and you can build there and start to build in things like data CMS to augment experimentation as well. So it's got a really strong a pathway to grow your MarTech platform if you're a small company or a big company.

Incentivized

Our marketing team does a lot of creative testing around messaging and imagery. VWO is well suited for this type of testing and can yield great results if you define your conversion goals correctly. However, when we have tried to do more substantial/advanced changes through VWO (such as re-positioning content or modifying elements in a form), we have had some challenges and not been able to get the desired tests working correctly.

Incentivized

• The Platform contains drag-and-drop editor options for creating variations, which ease the A/B tests process, as it does not require any coding or development resources.
• Establishing it is so simple that even a non-technical person can do it perfectly.
• It provides real-time results and analytics with robust dashboard access through which you can quickly analyze how different variations perform. With this, your team can easily make data-driven decisions Fastly.

Incentivized

• VWO has a strong support team willing to help provide answers to questions during the setup process. During setup, we had some questions regarding implementation across a significant number of sites and they were able to ease dev team concerns and provide detailed best practices to streamline integration.
• Some of the initial results of a few of the initial tests raised some questions internally. We setup a call and were able to quickly address the questions and find some opportunities to leverage moving forward.
• I discovered a bug within the UI that lead to some questions internally. I was able to report it and the problem was fixed rather quickly and their team followed up with a thank you for reporting it and to report the issue was now resolved.

Incentivized

• The results view is dense and difficult to package easily for leadership, and when filtering by segment it's hard to read comparative outcomes without clearing or swapping filters
• The organization of experiments and statuses is a cluttered list and the search is limited in use - would love to see that improve with time
• There are so many other MarTech products out there, would love to see more dedicated integrations so we don't have to invest in something like Zapier or Tray to build hacky automations

Incentivized

• The heatmaps within A/B tests are overlayed on the live website. Unfortunately, these don't work properly when scrolling down the site.
• I am missing an overview of all my custom conversions. I can only see a list of frequently used goals while setting up an A/B test, which may or may not include all custom conversions.

Incentivized

Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.

Visual Website Optimizer is a easy to use and powerful tool for testing web pages. We use it to test lead generation websites to increase the number of people that complete a form. Before we decided to go with Visual Website Optimizer we did research into other options and found Visual Website Optimizer to be one of the best.

Optimizely Web Experimentation's visual editor is handy for non-technical or quick iterative testing. When it comes to content changes it's as easy as going into wordpress, clicking around, and then seeing your changes live--what you see is what you get. The preview and approval process for sharing built experiments is also handy for sharing experiments across teams for QA purposes or otherwise.

Incentivized

Overall VWO is quite good with general user usability, and every person who has had to take up the mantle of using the tool itself has found it manageable. However there is definitely some room for improvement - again, perhaps this is particularly the case because we are running a large number of tests in a number of different languages (and markets, and countries!) which requires a lot of upkeep.

Incentivized

I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.

Incentivized

I have not experienced an application error or unplanned outage with VWO.

Incentivized

I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.

Incentivized

VWO doesn't appear to slow down our website at all, though some customers with adblockers like UBlock Origin have been known to not see entire pages if VWO is making changes to the page at a macro level (background, font, etc). This is rare though.

Incentivized

They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.

While their online document support is lacking a simple email to their support team will almost always get responded to the next day. It has however taken more than one email to explain the problem to the support team till they understood the problem. The solution I was given also only half fixed the problem the rest I figured out on my own.

The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).

Training was good, just limited to the onboarding process. They walked through all of the steps it takes to get started in VWO and each of the modules, along with giving us ideas for starting our first test. I feel like it could be better if there was a guided process within the VWO program to continue to educate you along the way, and a way to turn that off for experienced users.

Incentivized

The implementation through the tag management system took a bit of trial and error at first, mostly due to the asynchronous nature of the TMS. We had to manipulate the implementation to assure that the Optimizely code was written to the page at the right time to allow the experiment content load in the browser without showing any of the original content first. We also needed to make some adjustments to the TMS code to get the integration with Site Catalyst timed appropriately.

Overall, the implementation of VWO is straightforward. If you've got a straightforward way of deploying code to all of your test pages, either a good CMS or a TMS, then implementation should be a breeze. There is no tweaking to be done to the code itself, and once deployed it has the flexibility to cope with different VWO modules (tracking, conversion analysis, session analysis) without modification.

Incentivized

The ability to do A/B testing in Optimizely along with the associated statistical modelling and audience segmentation means it is a much better solution than using something like Google Analytics were a lot more effort is required to identify and isolate the specific data you need to confidently make changes

Incentivized

VWO is by far the easiest tool to use among all experimentation tools. It is like the experimentation tool for dummies and works as well as the others. A highlight would be the reports on every test because compared to the others, in VWO is way much easier to understand the metrics and the test performance.

Incentivized

It's incredibly flexible and adapts well to organizations of all sizes, whether you’re running a single site or managing multiple departments and platforms. The ability to deploy experiments seamlessly across different environments is a huge plus, especially for growing businesses. While it’s highly scalable, the last point would depend on the right team leveraging its full potential.

Incentivized

The product seems infinitely scalable for our needs (small business) and we've never had any issue with loading VWO-edited elements. I will say, though, that online customers with ad blockers have been known to not see certain VWO elements as their third-party scripts are disabled.

Incentivized

• we saved money by not implementing certain copy/design
• we learned that customers from different states react different to a variation
• we are slowly learning where conversion happens and where to fix the frictions
• Testing shorter vs longer journeys increased funnel conversion in some states - we avoided implementing this nationwide

Incentivized

• Our clients have seen significant increases in engagement and conversion rates through changes we recommended after using VWO to test our hypotheses.
• Our clients and internal teams have appreciated the level of granular detail available within the platform, as more information leads to more reliable optimization suggestions.

Incentivized