Optimizely

Raised as a usability problem by 7 people on Hacker News over 14 years (2010–2023), in 4 threads.

People raised many different problems with Optimizely, but no single problem has yet been raised by 3 people in 3 different months and threads.

Unreviewed issues were grouped by machine: Claude Haiku labelled each comment as a usability complaint, named what it's about and summed up the problem in a line, and a small model grouped similar problems. Nobody has checked them by hand. Expect mistakes.

The newest 7 complaints

Bad UI let people stop A/B tests early when metrics looked favorable, biasing results2023-06-23
Hard to read and sort; misleading controls; overlapping headings and half-hidden tables2014-06-21
Key metrics scattered across page; comparing goals requires extra clicks to reveal2014-06-19
Product is too complicated to use, needing academies and certification2014-05-05
Setting up A/B tests is much more complicated than before2014-05-05
Setting up tracking of AdSense clicks as a goal is not easy and requires writing code2010-10-14
Visitor-count pricing metric is hard to interpret without A/B testing knowledge2010-10-13