Products A/B Test for Shopify

Products A/B Test

Choose the Best Name, Price and Description for Your Product
Developer
SpurIT LLC
View on App Store
Products A/B Test
Rating
1.0
Feedback
2
Reviews
Chart
#8,506
Shopify
Reviews over time
New reviews per month across the app's lifetime.
App ranking
Overall position in the Shopify App Store.
Reviews summary

The reviews are strongly negative and focus on a core product limitation: users feel the app cannot perform true A/B testing because it does not allow simultaneous traffic splitting between two variants. Reviewers say this makes the results unreliable or mathematically invalid, since testing versions at different times introduces outside variables like changing traffic, sales trends, and conversion rates. As a result, they believe the app is not useful for generating statistically significant conclusions. There are essentially no positive aspects mentioned in these reviews. Instead, both reviewers express frustration that the app’s testing approach is flawed and that the missing split-traffic functionality makes the product ineffective or even worthless for its intended purpose. The feedback suggests a mismatch between the app’s promise and what it can actually deliver.

Time spent using app
How long merchants keep the app installed.
Less than an hour 50%
Less than a day 50%
Less than a month 0%
Less than a year 0%
More than a year 0%
All reviews
1 / 5 Share
Oct. 30, 2025

A split test where you cannot split your traffic between two sources is effectively useless. You have to schedule one test during one time period and the other after. This creates an unknown variable of traffic. Not having this functionality makes this app worthless

Store Using app Total reviews Average rating
DeadEyeVR 8 minutes 4 3.3
Developer Reply

Thank you for your feedback. Please note that the app's description clearly explains how the app works. If you check on it, you will find the same information you mentioned in the review. We are sorry that the app didn't meet your needs. We do our best to inform users about the app's workflow to avoid misunderstandings regarding its functionality.

2 / 5 Share
July 23, 2019

It is mathematically impossible for the data returned from this app to be correct. Switching out different versions of a product over a fixed time period won't tell you anything because both unit sales and conversions naturally change over time. The only way to get statistically significant A/B testing values is to run two variations simultaneously, which this app can't do.

Store Using app Total reviews Average rating
3DUPfitters About 19 hours 6 3.0
Developer Reply

We're very sorry to hear that you've run into an issue with our app, and we would really like to look into this further for you. Whenever convenient for you, please respond to our email and let us know when we can connect with you over the phone in order to solve this issue. Again, we are very sorry for any inconvenience this has caused and would like to rectify the issue immediately.

Sign up to receive AppNavigator updates

Find out when we add keyword-monitoring, review RSS feeds and more.