It is a little too limited for a full stack experimentation programme. Many times we required development support or tech advise but we were simply unable to get this due to it being google. This was a big problem for us. However it is quite good if you were looking to get started in experimentation and didn’t have the budgets for a wider tool
This is clearly a platform built around experimentation first, and it shows. In this way Statsig is way ahead of the competition of products I've used previously! It's more data science focussed which makes configuration of new experiments complex with a learning curve.
Easy to follow set up procedures. Once I walk a client through the process, it's effortless for them to emulate on subsequent tests.
Lots of geo and user attribute customization features to be able to drill down into specific targeted audiences — all based on the power of Google's immense data system.
Google Optimize is the logical choice for many people to start with since most are already familiar with and using GA.
For the most part it is pretty easy to use. - There are some quirks with the javascript SDK (getExperiment().getValue?). - The Events vs. Metrics design pattern is complex, and creating new Metrics from Events can be frustrating if you are trying to use event metadata - It's really frustrating not to be able to link Static IDs (before a user signs up) to User IDs, in order to follow users all the way through onboarding, or to log events that occur for signed in users when you are exposing the experiment to users before they've signed up
Google Optimize being part of the Google stack makes it great in reporting and analysis. Wish Google would add more features like dynamic tests, multi funnel tests, conversion calculator based on the total number of traffic of the page being tested instead of using the websites total traffic. Should integrate form analysis, heatmap, and page analytics.
