Theme Scientist A/B Testing
Theme Scientist A/B Testing
Rating
3.8
feedback
16
chart
#1,607
All reviews
Rating Breakdown
Review RSS Feed
Aug. 12, 2024
This is a very useful app, and it's free! Helpful support staff, easy to use, I'm very happy.
Nov. 20, 2023
don't even deserve to give a star ,the app isn't even responding
Dear HudaOrganics, Thank you for your feedback. We’re sorry to hear that you were experiencing issues with the app. Your experience is important to us, and we’re committed to resolving this problem. Our support team would be more than happy to help you get your A/B Tests up and running. Please reach out we will would love to resolve this issue for you. All the best.
June 5, 2023
Customer support is really bad at responding to this app. Our data had discrepencies that don't make sense/ need explanation on almost every test and their team does not get back to you for at least 5 days when you have a question, sometimes never.
Hello Print Your Places, We are sorry for the challenges you've faced with our app and the delay in receiving support. Your feedback is crucial to us, and we deeply regret any inconvenience it may have caused you. Our customer support team strives to provide timely assistance, and we have taken steps to ensure that your inquiries are addressed promptly moving forward. We understand your concerns regarding data discrepancies and unanswered questions, and we're committed to addressing these issues promptly. When discrepancies arise or you have questions about our app, we encourage you to reach out to our support team immediately. Our goal is to assist you swiftly and efficiently. To further expedite the resolution process, we usually request collaborator access to your store. This enable us to investigate the issues you've encountered and work closely with you until a solution is found. Please feel free to contact us directly via email/chat. We're here to assist you every step of the way. Thank you for giving us the opportunity to address these concerns, and we look forward to improving your experience with our app.
Sept. 1, 2022
Great concept poor execution. I have been trying to get in touch with someone from support for the past couple days. The metrics that are being shown on the AB test are not accurate and due to that we are being shown false metrics on which test is winning.
Dear Altered Way, Thank you for sharing your feedback. We genuinely appreciate you bringing this to our attention and apologize for the inconvenience you’ve experienced. We understand the frustration caused by the inaccurate AB test metrics and the delay in reaching our support team. We are pleased to inform you that the issue has since been fixed. Our team has worked diligently to resolve the inaccuracies, and the metrics should now reflect the correct data. Please let us know if you encounter any further issues or if there is anything else we can assist you with. Your satisfaction is our top priority, and we are committed to ensuring you have a positive experience with our service. All the best
Aug. 22, 2022
This app is easily one of our favorites and most used tools. We've used it to test multiple growth ideas and increase our revenue by over $50k a year so far. Developers are responsive, kind and very helpful. They've even introduced me to other products and people that could have been a better option for us. We want to test store-wide features so we create 2 versions of the same theme, and every 24 hours the theme switches. It's obviously more ideal to split visitors live, but Shopify seems to restrict developers from creating this experience. Everyone on our team is always really excited about our tests and results. My 2 requests would be to add slightly more robust insights on the results table and to be able to split audiences live (fingers crossed one day shopify will let it be built!)
Feb. 8, 2022
Great app! Our team has been using this app for over a year to run A/B tests on products and website features - always testing something. We use a set it and forget it style: create a test, wait a few weeks or so, analyze the results, then start another test. The best for us has been testing product prices. Finding a better product price is golden!
Feb. 1, 2022
I really like the interface and i am nearly fully happy! BUT i would like to set the swapping times to something uneven, like 1/3/5/7/9 hours in order to really give every option the same time frames during a day. If i put my A/B test to swap every 4 hours for example, A would get 8-12 and 16-20 o clock every single day, which would mix up by swapping them every 3 hours. I would love, that you update this feature in the near future and ill happily give you 5 stars Great job guys! Love the update! Cheers :)
Thank you for the feedback. We often implement new features based on request, and this sounded like a great idea. Our team went ahead and added the additional interval options to both Theme A/B tests and Product A/B tests the very next day! If you have any other feature requests, please email us. Our team is here to make Theme Scientist better for all Shopify Merchants!
Dec. 13, 2021
Great app for those looking to make more informed decisions when it comes to theme updates. Also the support team is very responsive.
Thank you for sharing, and appreciate the compliment on the support, we enjoy community feedback and helping you get the best from your A/B testing experience!
Nov. 9, 2021
We use the app free features to schedule theme change (for our sales, flyer, etc.) it is really easy to use and effective. The changes are done at the time scheduled. The support team is really nice too!
Niiiice thanks for representing the free plan and sharing your feedback, cool to hear it's providing you value for you. Thank you!
Sept. 16, 2021
It's the perfect tool to run AB Test on the Theme, simple and efficient. Unfortunately, at the moment I start an AB Test, I have visitors from the US, tons of visitors and all my KPIS are skewed. That's very sad.
Using app
5 months
Total reviews
1
Average rating
2.0
We appreciate the compliment on our app, but not sure exactly how to respond here :) ... All our app does is swap the test versions, read the data, and report the statistics on the actions they take (visitors, page views, orders, etc). We can't control the people in a specific country that visit your site (would love to help send you more traffic but that's impossible). Tried reaching you by email, we like stats and analytics so would be happy to help you out. Not sure why we're getting the blame here but we're friendly folks, just contact us and we'll do our best to help out.
July 12, 2021
The best split-testing app I've tested so far, there is everything I need and the customer service is super reactive! I also suggested a new feature and it got added !! 100% recommended
Love the enthusiasm, thanks! We appreciate the feature suggestions and will continue adding more :)
June 10, 2021
This is a beautiful app! Don't let the currently small number of reviews turn you off. It's ease of use, simplicity, and effectiveness are top notch. It works like an absolute charm. And apparently - the dev crew is fantastic also, that's why I'm writing this review, I casually mentioned a feature I thought would be good, and wouldn't ya just know it, they said they will add it in - and quite soon even. Yea, for AB testing, it's rad. Theme testing and product testing with price testing also. It's legit awesome.
Thank you! And yes your feature was a great request we're always ready to listen and add more functionality, coming soon. We appreciate you.
April 6, 2021
Don't let the lack of reviews for Theme Scientist scare you away. We actually tried them all, and were ready to give up when we took a shot on TS with no reviews. Wow, intuitive, exactly the type of tests we were looking for, and unlike some of the others, it never broke themes while testing. We are actually in the ABT mode (Always Be Testing) now for life now, and this App has already given us the insights to double, yes double our conversion rates in 3 months. Word of wisdom, small tests, and keep variables isolated, so you know what is moving the needle. Last but not least, Joe, the man behind the curtain is an absolute Rockstar. Like us, always putting the customer first, and genuinely concerned about us maximizing our value from the app. Fantastic product, fantastic company, fantastic customer service!
Wow epic review thanks for sharing! Haha ABT for sure that's the winner's mindset, testing is where it's at. We're happy to hear the app is helping grow your business, and we're very appreciative of you sharing your experience. Thank you
June 16, 2020
Super clean, powerful app that lets you alternate between themes for split testing. Being able to customize an entirely separate theme gives you almost unlimited flexibility to tweak and test. It tracks the views, add to carts, conversion rates, and provides statistical significance levels so you know when to choose the winning version. The team behind the app are great, I hired them in the past to speed up my site and add lazy loading to images. They're very responsive, always improving and building new features and products based on suggestions.
Right on thank you so much for both the review and complements to the team, we really appreciate it!
April 18, 2020
That is the A/B Split testing App I was waiting for long time! We know the developer through his expertise in speed optimization. Great customer support, with passion that always goes a extra mile! We were also told a few more features are in the pipeline for this App. Thus, we are really exited to see this app developing even further!
Thank you so much for the encouragement, love the excitement what a great motivator for us to keep going strong!
April 16, 2020
I used this app to run a test on the color of the buy button. It was easy to set up and it ran without a hitch. I did get a clear winner. I had an idea to make it work better and reached out to Joe, the founder. He was very responsive and did implement my suggestion. I highly recommend this app.
Woohoo cheers to a successful experiment! 🎉