Shopify SimGym

It is an interesting idea and fun to test, but in its current form, the results are too unreliable to serve as a basis for decision-making. Several AI users misinterpreted the product variant displays, believing a purchasable variant was out of stock—even though the available option was clearly marked and could be added to the cart. This led to reports of issues that did not actually exist. The concept has potential and the simulations are interesting to watch, but the app needs to get much better at interpreting standard product and variant interfaces before the results can be considered useful for CRO or store improvements.

SimGym scheint gegen einen veralteten Snapshot statt den aktuellen Live-Zustand der Seite zu testen, was dazu führte, dass ein Großteil der Befunde im zweiten Durchlauf bereits gefixte Probleme aus dem ersten Durchlauf waren — reiner Doppelaufwand bei der Verifikation. Die Meldungen beschreiben durchweg nur Symptome und keine Ursache, sodass jeder Befund erst manuell nachrecherchiert werden muss, was in der Praxis oft länger dauert als der eigentliche Fix. Am schwerwiegendsten ist, dass SimGym nicht zwischen echten Bugs und Test-Infrastruktur-Artefakten unterscheidet: mehrere gemeldete "Fehler" entpuppten sich als Session- beziehungsweise Cookie-Kontamination zwischen einzelnen Testläufen und nicht als tatsächliche Probleme der Website, was ohne eigene Nachprüfung leicht zu blindem Fixen nicht existierender Fehler geführt hätte.

Doesn't seem useful. The suggestions are very generic.

Great idea but currently immature - I have run a sim on my live theme. Ai shoppers are not using my site's mega menu so many comments regarding discoverability are just plain wrong - it's even suggesting adding a mega menu lol. In other areas, it's misinterpreting a sign-up pop-up for cookie consent, not viewing my drawer style cart properly etc. It also uses daft language like pills and chips - just use plain English (preferably UK!). I use the Impulse theme so it's not as if I'm using a cheap and nasty baseline. I will continue to review the detailed analysis because I can already see one or two valid and actionable things, but because it cant be wholly trusted, I certainly wouldn't want to pay for these outputs. I'll pop back for another go in 6 to 12 months perhaps.

Creates an anomaly in your traffic in google analytics, including conversion tracking like add to carts and beginning checkout. Very frustrating that this distorts the analytics, this should be made clear. Also, I think this is only useful if you're making massive theme changes and comparing two very different user experiences.

Since it’s a shopify app I expected it to be free. Maybe they will make it free after this early access.