Products A/B Test for Shopify

Products A/B Test

Choose the Best Name, Price and Description for Your Product

Developer
View on App Store

Rating

1.1

feedback

2

Reviews

chart

#16,492

Shopify

Reviews Over Time

App Ranking

Time spent using app

  • Less than an hour
    0%
  • Less than a day
    50%
  • Less than a month
    0%
  • Less than a year
    0%
  • More than a year
    0%

Reviews Summary

Merchants are disappointed with the app's inability to split traffic between two sources for effective split testing. This limitation leads to unreliable results due to the unknown variable of traffic when scheduling tests at different times. Additionally, users express concerns about the app's inability to provide accurate data as unit sales and conversions naturally fluctuate over time. The lack of simultaneous testing for two variations hinders the ability to obtain statistically significant A/B testing values, rendering the app ineffective for meaningful analysis.

Highlights

Ineffective split testing due to the inability to split traffic between two sources
Unreliable results from scheduling tests at different times
Inaccurate data due to natural fluctuations in unit sales and conversions
Lack of simultaneous testing for two variations
Ineffectiveness for meaningful analysis

Rating Breakdown

  • 5
    0% (0 ratings)
  • 4
    0% (0 ratings)
  • 3
    0% (0 ratings)
  • 2
    50% (1 ratings)
  • 1
    50% (1 ratings)

Reviews with Text

  • 100% (2)
Review RSS Feed Review RSS Feed

All reviews

1 / 5 Share

Oct. 30, 2025

A split test where you cannot split your traffic between two sources is effectively useless. You have to schedule one test during one time period and the other after. This creates an unknown variable of traffic. Not having this functionality makes this app worthless

Using app

--

Total reviews

3

Average rating

3.7

2 / 5 Share

July 23, 2019

It is mathematically impossible for the data returned from this app to be correct. Switching out different versions of a product over a fixed time period won't tell you anything because both unit sales and conversions naturally change over time. The only way to get statistically significant A/B testing values is to run two variations simultaneously, which this app can't do.

Using app

About 19 hours

Total reviews

6

Average rating

3.0

Developer Reply

We're very sorry to hear that you've run into an issue with our app, and we would really like to look into this further for you. Whenever convenient for you, please respond to our email and let us know when we can connect with you over the phone in order to solve this issue. Again, we are very sorry for any inconvenience this has caused and would like to rectify the issue immediately.

All reviews

Sign up to receive AppNavigator updates

Find out when we add keyword-monitoring, review RSS feeds and more