Theme Scientist A/B Testing
The reviews for this Shopify App are mixed, with both positive and negative feedback. On the positive side, users appreciate the app's effectiveness in running A/B tests and theme changes, with some reporting significant revenue increases and improved conversion rates. The developers are praised for their responsiveness, helpfulness, and willingness to implement user suggestions. Users also like the ease of use and flexibility of the app, as well as the detailed insights it provides for testing. However, there are some negative aspects highlighted in the reviews. Users have expressed frustration with changes in pricing plans and delays in customer support responses, with some mentioning discrepancies in data and the need for more robust insights.
Review RSS feed
They change their plans so you have to keep upgrading to keep using the same features.
Hi there, Thank you for your feedback. Earlier this year, we informed all users that we would be updating our pricing plans. At the time, we were offering both a free plan and a free trial, but unfortunately, it became unsustainable to support both. To simplify things and continue providing high-quality features and support, we transitioned to a single, 14-day free trial that includes access to all features. To clarify, you do not have to keep upgrading to retain the same features. Our plans are based solely on your store’s monthly order volume—there are no hidden changes or surprise downgrades. From your review, it sounds like something may not be functioning as expected, and we’d really like to take a closer look. Please reach out to our support team directly through the app—we’re here to help and ensure everything is running smoothly for you. Thank you again for your feedback, The Theme Scientist Team
Customer support is really bad at responding to this app. Our data had discrepencies that don't make sense/ need explanation on almost every test and their team does not get back to you for at least 5 days when you have a question, sometimes never.
Hello Print Your Places, We are sorry for the challenges you've faced with our app and the delay in receiving support. Your feedback is crucial to us, and we deeply regret any inconvenience it may have caused you. Our customer support team strives to provide timely assistance, and we have taken steps to ensure that your inquiries are addressed promptly moving forward. We understand your concerns regarding data discrepancies and unanswered questions, and we're committed to addressing these issues promptly. When discrepancies arise or you have questions about our app, we encourage you to reach out to our support team immediately. Our goal is to assist you swiftly and efficiently. To further expedite the resolution process, we usually request collaborator access to your store. This enable us to investigate the issues you've encountered and work closely with you until a solution is found. Please feel free to contact us directly via email/chat. We're here to assist you every step of the way. Thank you for giving us the opportunity to address these concerns, and we look forward to improving your experience with our app.
This app is easily one of our favorites and most used tools. We've used it to test multiple growth ideas and increase our revenue by over $50k a year so far. Developers are responsive, kind and very helpful. They've even introduced me to other products and people that could have been a better option for us. We want to test store-wide features so we create 2 versions of the same theme, and every 24 hours the theme switches. It's obviously more ideal to split visitors live, but Shopify seems to restrict developers from creating this experience. Everyone on our team is always really excited about our tests and results. My 2 requests would be to add slightly more robust insights on the results table and to be able to split audiences live (fingers crossed one day shopify will let it be built!)
I really like the interface and i am nearly fully happy! BUT i would like to set the swapping times to something uneven, like 1/3/5/7/9 hours in order to really give every option the same time frames during a day. If i put my A/B test to swap every 4 hours for example, A would get 8-12 and 16-20 o clock every single day, which would mix up by swapping them every 3 hours. I would love, that you update this feature in the near future and ill happily give you 5 stars Great job guys! Love the update! Cheers :)
Thank you for the feedback. We often implement new features based on request, and this sounded like a great idea. Our team went ahead and added the additional interval options to both Theme A/B tests and Product A/B tests the very next day! If you have any other feature requests, please email us. Our team is here to make Theme Scientist better for all Shopify Merchants!
We use the app free features to schedule theme change (for our sales, flyer, etc.) it is really easy to use and effective. The changes are done at the time scheduled. The support team is really nice too!
Niiiice thanks for representing the free plan and sharing your feedback, cool to hear it's providing you value for you. Thank you!
Sign up to receive AppNavigator updates
Find out when we add keyword-monitoring, review RSS feeds and more.