Products A/B Test
Merchants are expressing frustration with the app's inability to split traffic between two sources for accurate split testing. The lack of this functionality renders the app useless as it introduces an unknown variable of traffic, impacting the reliability of test results. Additionally, users highlight the mathematical inaccuracy of the data provided by the app due to the inability to run simultaneous A/B tests. Running tests sequentially over fixed time periods leads to skewed results as unit sales and conversions naturally fluctuate.
Review RSS feed
A split test where you cannot split your traffic between two sources is effectively useless. You have to schedule one test during one time period and the other after. This creates an unknown variable of traffic. Not having this functionality makes this app worthless
Thank you for your feedback. Please note that the app's description clearly explains how the app works. If you check on it, you will find the same information you mentioned in the review. We are sorry that the app didn't meet your needs. We do our best to inform users about the app's workflow to avoid misunderstandings regarding its functionality.
It is mathematically impossible for the data returned from this app to be correct. Switching out different versions of a product over a fixed time period won't tell you anything because both unit sales and conversions naturally change over time. The only way to get statistically significant A/B testing values is to run two variations simultaneously, which this app can't do.
We're very sorry to hear that you've run into an issue with our app, and we would really like to look into this further for you. Whenever convenient for you, please respond to our email and let us know when we can connect with you over the phone in order to solve this issue. Again, we are very sorry for any inconvenience this has caused and would like to rectify the issue immediately.
Sign up to receive AppNavigator updates
Find out when we add keyword-monitoring, review RSS feeds and more.