Yes, I’ve started checking it manually by asking ChatGPT, Gemini, and Perplexity questions related to my products to see if my store appears.
There isn’t a reliable way to track AI visibility yet, so the best approach is to keep following good SEO practices: clear product information, helpful content, structured data, and building your brand’s authority. That helps with both Google and AI search.
it is true. we are seeing a shift from organic traffic to AI traffic.
well, i am using MentionBird.ai to check if i getting mentioned and cited for relevant prompts across ChatGPT, Gemini, Perplexity, and other platforms. it allows me to track visibility across all the relevant prompts on a daily basis, and even provides me AI ranking advice in terms of what should i do next to get recommended for a prompt.
it’s going pretty well with the tool and i am seeing that my AI mentions have risen recently compared to other competitors
Normally, it happens when some updates are made, such as publishing some new content, updating product pages, or adding new collections. In case there have not been any important updates, a monthly check would be enough.
However, since AI search is in its developing stage now and there is no tracking system available for it yet, it is necessary to concentrate more on content optimization. This will help to understand whether there is some effect on the site’s visibility.
That makes sense. I think most merchants are doing something similar right now.
Hopefully we’ll see better ways to measure AI visibility over time, especially beyond just checking prompts manually. It feels like this area is evolving much faster than the available tools.
If you found my solution helpful, I’d really appreciate it if you could mark it as the solution. And I’ll be available to help you with anything you need in the future as well.
Most of us are definitely thinking about AI search, but measuring it is still a huge guessing game. Unlike Google Analytics, there is no simple dashboard showing how many times ChatGPT mentioned your store. However, there is no denying how important AI search is right now. When an AI tool directly answers a question by recommending your store, it builds massive brand credibility. It acts as the ultimate social proof, and the people clicking through are usually highly targeted and ready to buy.
To get those recommendations, you have to understand that AI bots do not browse websites like humans do. They read raw code. They look for perfectly structured data to understand exactly what you sell. They also look for mentions of your brand on other trusted websites, like Reddit or blogs, to verify that real people actually like your products.
To make sure these AI engines can actually read your store data, your backend schema markup needs to be absolutely flawless. To handle this without touching any complicated code, I highly recommend using SearchPie: SEO, Speed & Schema. It automatically builds advanced structured data (JSON-LD) for your products. This acts like a perfect cheat sheet for AI bots, helping them confidently recommend your store and boost your credibility.
I think this is becoming an increasingly important part of SEO.
While traditional Google rankings still matter more merchants are starting to check how their brands appear in AI generated responses from tools like ChatGPT, Gemini, and Perplexity especially for product discovery and buying related queries.
At the moment there isn’t a universally accepted way to measure AI visibility. From what I’ve seen merchants are typically:
Manually testing relevant prompts to see whether their brand or products are mentioned.
Comparing branded and non branded queries across different AI platforms.
Monitoring organic search performance alongside referral traffic and brand mentions to identify any impact from AI driven discovery.
It’s still early but AI visibility is likely to become another metric to monitor alongside traditional SEO as search behavior continues to evolve.
I’d check monthly as a baseline, then again 2 to 3 weeks after a meaningful content or collection update. Daily checks create noise because answers can vary by model, location, and wording.
My simple process:
Keep a sheet with 15 to 20 buyer prompts, such as best product for a specific use case, comparison, and alternatives.
Run the same prompts in ChatGPT, Gemini, and Perplexity while logged out when possible.
Record whether the store is mentioned, which page is cited, and which competitors appear.
Repeat prompts with only minor wording changes. One mention from one exact prompt is not a reliable trend.
I also tag AI referrals in Shopify analytics when the source is visible, but I treat that as directional since some visits may show as direct traffic.
Good thread. One thing worth checking before even getting into the manual-prompt-testing loop everyone’s describing: whether these bots can actually reach your content at all.
Two quick checks:
robots.txt — OAI-SearchBot (ChatGPT’s live search/citation crawler, different from GPTBot which is just training data) and PerplexityBot both respect standard robots.txt Disallow rules. A lot of stores that installed some “AI blocker” app or an overly aggressive bot-management app end up accidentally blocking these too, without realizing it — worth just pulling up yourstore.com/robots.txt and checking for those user-agents explicitly.
Whether your structured data is actually server-rendered. View Page Source (not Inspect Element) on a product page — if your JSON-LD Product schema only shows up in Inspect Element but not View Page Source, it’s being injected by JavaScript after load, and a lot of these crawlers (same as classic bots) don’t execute JS. So the schema you’re counting on might be invisible to exactly the bots you’re trying to get cited by.
Neither of these fixes the “no reliable way to measure” problem everyone’s talking about, but they’re worth ruling out first — no point building a prompt-testing spreadsheet if the bots can’t even see your pages.
That’s a great point. I think a lot of merchants don’t realize AI crawlers can be blocked unintentionally, especially after installing certain apps or changing robots.txt.
The server-rendered JSON-LD point is interesting too. It’s easy to assume schema exists just because it appears in DevTools.
Have you seen this happen often on Shopify stores?
Yeah, more than I’d expect. It’s usually not the theme’s own Product schema — that’s almost always server-rendered by default. It’s schema bolted on afterward: review/rating apps, FAQ builders, or “SEO booster” style apps that inject their JSON-LD via a script tag that runs client-side rather than writing it into the Liquid template. Reviews/AggregateRating schema is the one I see it with most, since a lot of review apps load asynchronously.
Quick way to check without even opening DevTools: curl -s yourstore.com/products/handle | grep -i 'ld+json' from a terminal, or the “Text-only” view in Google’s Rich Results Test — both only see what actually ships in the initial HTML, same as a non-JS crawler would.
Good thread. Most of the replies above are about detecting whether you show up in AI answers (manual prompting, MentionBird, structured data). That’s the visibility side. The part that gets skipped, and honestly matters more for a Shopify store owner than a ranking screenshot, is what happens after someone clicks through from ChatGPT, Perplexity, or Gemini into your store.
A few things worth checking that haven’t come up yet:
Referrer headers from AI platforms are inconsistent. Perplexity and Gemini generally pass a referrer, ChatGPT’s in-app browser often strips it, so a chunk of that traffic lands in your analytics as “direct” with no way to tell it came from an AI answer. If your direct traffic has crept up with no obvious cause, that’s a signal worth checking.
UTM tagging is the only reliable fix. If you can influence how your brand gets cited (e.g. through a llms.txt file, structured data, or content that AI tools tend to quote verbatim with a link), tag that link with UTM parameters the same way you would for any paid or affiliate channel. Without it, you’re stuck guessing.
Shopify’s own Analytics > Sessions by referrer report will show you AI platforms as a source once traffic starts flowing (grouped as web referrals), but it won’t tell you whether that traffic actually converts to sales, just that it landed on the site.
That last gap, seeing whether AI-referred sessions turn into revenue rather than just pageviews, is where I’ve found a reporting layer more useful than Shopify’s native analytics. In Mipler you can build an orders-by-referring-site or sales-by-UTM-source report, filter it to isolate chatgpt.com, perplexity.ai, gemini.google.com etc., and see actual order counts and revenue tied to that channel over time, not just session counts.
Are you already seeing any AI-platform referrers show up in your existing analytics, or is this still purely a “we suspect we’re missing it” situation?
At the moment it’s mostly a “we suspect we’re missing it” situation. We can see occasional AI referrals, but tying them back to specific prompts or measuring their business impact is still the biggest challenge. I think better attribution is the missing piece right now.
Good thread — Markk’s right that attribution is the hard part after the click. I’d add the step that sits before attribution, because it’s often the reason there’s nothing to attribute in the first place: can the AI even read you?
Two quick checks decide it:
robots.txt: the crawler that matters for ChatGPT search is OAI-SearchBot (GPTBot is only training — allowing it does nothing for citations). PerplexityBot for Perplexity. Shopify’s defaults are fine, but custom themes/apps sometimes add blocks.
Schema in raw HTML: product page → View Page Source → search “ld+json”. Product + Offer (price, availability) need to be in the served HTML. If they only appear in Inspect Element, they’re JavaScript-injected and the non-JS AI crawlers never see them.
If those two are broken, you won’t see AI referrers no matter how clean your UTM setup is — there’s simply no citation happening upstream to measure. Get read first, then worry about attribution (which, agreed, is genuinely messy today).
Yes. We manually test key prompts in ChatGPT, Gemini, and Perplexity, then monitor AI referral traffic in analytics. it’s still early, but it’s becoming a useful SEO metric.
One thing I’ve started paying more attention to is the actual prompts customers use. It’s easy to test “best Shopify SEO app,” but buyers usually ask much longer questions like “What’s the best SEO app for a small Shopify store?” or “How do I fix duplicate content on Shopify?” Those are the prompts I’d track consistently.
I’ve started checking every now and then, mostly out of curiosity, but I wouldn’t say I have a reliable way of measuring it yet.
What I’ve changed is spending less time optimizing pages that barely matter and more time making sure the important product and collection pages are in good shape. SiteGuru has actually helped with that since it shows revenue alongside the audit, so it’s easier to prioritize pages that are already contributing to the business.
I still think we’re in that awkward stage where everyone knows AI search matters, but there isn’t a great way to track it consistently yet. Right now it feels more like spot-checking than something I’d put on a dashboard every week.