ABConvert: A/B Testing
All reviews
Review RSS feed
The app works for small tests. It is not suitable for template tests. Variants are applied client side after the page loads, so visitors in the test group see the original page render first, then watch it get replaced. There is no anti flicker option and no URL split option. For a full template test that is a systematic bias against your variant. We ran 8 days of paid traffic through a test before finding this. AI support proved to be misleading on one occasion. One a second it could not define two metrics on their own dashboard. Fine for price tests and small changes. Do not use it to test a new page design on mobile traffic - your test variant traffic will be served control first, which is an unfair test. The flicker limitation should be disclosed when creating a template test. It is not.
Amazing app, bad operation. The functionality of the app itself is great- you can run tests that improve your conversion rate by 0.1%, which is a lot. However, the app lacks in support and self-support- not because of the support staff, but because of the working hours and the way errors are not communicated. I've attempted creating the same price test over 10 times by now- each time, taking ~30 minutes. Once the test fails, all it does is not show up in the "Your tests" section- no visible feedback on why it failed. The support works 9am to 6pm- Beijing time- meaning during regular business Hours in the Americas, you have no support.
[UPDATE] We don't have an issue like this with price tests anymore, since we use the Shopify function for price tests, which is open to all plans now. ----- Hello, Thank you for your detailed feedback — it’s very helpful to us. I’d like to clarify one point: while our main support team is based in Asia, we also provide coverage outside of Beijing hours. For example, Kelly from our team works in UTC+1 (French time), which overlaps with part of U.S. business hours. In your case, she responded within 10 minutes, though we understand it still felt late given the situation. You’re absolutely right, our support coverage during U.S. hours can be improved, and we’re already working on expanding availability. We’re also addressing how errors are communicated in the app so that test failures give clearer feedback. We appreciate your honest review and will use it to keep improving both our operations and your experience
Sign up to receive AppNavigator updates
Find out when we add keyword-monitoring, review RSS feeds and more.