Products A/B Test
The reviews are strongly negative and focus on a core product limitation: users feel the app cannot perform true A/B testing because it does not allow simultaneous traffic splitting between two variants. Reviewers say this makes the results unreliable or mathematically invalid, since testing versions at different times introduces outside variables like changing traffic, sales trends, and conversion rates. As a result, they believe the app is not useful for generating statistically significant conclusions. There are essentially no positive aspects mentioned in these reviews. Instead, both reviewers express frustration that the app’s testing approach is flawed and that the missing split-traffic functionality makes the product ineffective or even worthless for its intended purpose. The feedback suggests a mismatch between the app’s promise and what it can actually deliver.
A split test where you cannot split your traffic between two sources is effectively useless. You have to schedule one test during one time period and the other after. This creates an unknown variable of traffic. Not having this functionality makes this app worthless
Thank you for your feedback. Please note that the app's description clearly explains how the app works. If you check on it, you will find the same information you mentioned in the review. We are sorry that the app didn't meet your needs. We do our best to inform users about the app's workflow to avoid misunderstandings regarding its functionality.
It is mathematically impossible for the data returned from this app to be correct. Switching out different versions of a product over a fixed time period won't tell you anything because both unit sales and conversions naturally change over time. The only way to get statistically significant A/B testing values is to run two variations simultaneously, which this app can't do.
We're very sorry to hear that you've run into an issue with our app, and we would really like to look into this further for you. Whenever convenient for you, please respond to our email and let us know when we can connect with you over the phone in order to solve this issue. Again, we are very sorry for any inconvenience this has caused and would like to rectify the issue immediately.
Sign up to receive AppNavigator updates
Find out when we add keyword-monitoring, review RSS feeds and more.