Chartbeat vs. Google Content Experiments (discontinued)

It is well suited to keeping me toward a specified goal, and gives me concrete numbers and gives me an idea of what we need to do to meet our goals. It's less appropriate if you want something more than pageviews, and doesn't really do a lot for video views.

Incentivized

Google Content Experiments is suited for large and small organizations, no matter your organizational goals. It is not recommended for organizations that are only interested in qualitative data, as there are other tools for receiving specific user experience feedback. It is also not recommended that you implement tests without some sort of goal in mind.

Incentivized

• Provides easy at-a-glance look at what people are reading right now
• Heads-up Display allows you to make sure the homepage is showing the content people want to read
• Headline testing tool provides fascinating insight into what makes people read a story and improves headline-writing ability

• When you need to measure against event-based goals
• If you need to see how the test variations performed against secondary goals
• Given that the the platform requires you actually code a new page with a unique URL, this tool can be good for radical redesigns.
• Great insights into other information about your testing groups, like whether or not they're mobile, screen size, browser, or really any dimension available in GA.

• Source of traffic needs improvement. Search and social make sense, but "internal" and "links" is a grey area. It would be helpful to define those with an organization and provide an information icon so users can easily remember what each of those buckets is tracking.
• More ways to customize the real-time board. For example, with video content, that's great that I can see a user has started a video, but what is the completion rate, was that only on O&O or can that track Facebook, too?
• Would like to see demo (age) information included as a way to slice the data so I can see what's working with my older and younger demo.

Incentivized

• You can only optimise for one goal, so if you have several conversions, like phone call and email you need to do it manually.
• It seems not to work that well for pages with lower amounts of traffic - not great for new or niche sites.

Incentivized

I gave Chartbeat a 5 for a renewal rating, because, while it delivers clear and understandable content, Google Analytics also provides many of the same features for free. For a small to medium website, I believe it would be more cost effective to use Google Analytics. A website with a high amount of traffic, however, could merit spending the money on Chartbeat to maximize their potential.

Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.

Chartbeat is really pretty straightforward. The only things that may cause confusion are the string of sidebar features and tools at the left of the screen. I mostly use the big leader board in real-time and the historical feature (looking at the monthly or weekly performance of my team's content) and then generate reports automatically from there.

Incentivized

I have had limited experience of support for Chartbeat but whenever I have needed help it has been there. Recently there was an issue of seeing different forms of data in real time - app and otherwise effectively, and the issue was being clearly dealt with and communicated back to us.

Incentivized

Using the free tool, overall "live support" is limited. However, there are plenty of online resources to get started. If you need handheld support, it is best to upgrade the service or hire a developer through one of Google's partner agencies. There could be more support for understanding what makes a test useful or not.

Incentivized

Google Analytics has gradually become much more difficult to use, and much slower in its realtime reporting. It was the changes that came in with Google Analytics 4 that gave us the final push to work with Chartbeat - a product some of us were already familiar with from previous jobs. Things are just much harder to find in GA, and when time is always tight you can't afford to spend a long time looking for particular data - it should be quick and easy to locate

Incentivized

Google Website Optimizer was a better product but has been discontinued. We have also used Test and Target , which has more features but we have been doing fine with Google Content Experiments. Most testing situations can be handled with Google Content Experiments.

Incentivized

• It has helped us save time in report generation and performance analysis.
• By helping us evaluate our contributors, we're able to get our money's worth.
• Seeing our numbers on the Big Board fosters healthy competition among brands, motivating us to distribute our stories better.

Incentivized

• Doing good experiments/Optimize has helped to take out the guesswork of the things we want to implement.
• We have done fairly complex changes such as changing navigation and managed to see improvements outcomes immediately before we have to request developer.
• Our teams have become more data centric in how they approach changes.

Incentivized