Shop Pay link marked 406 by my crawler

[nr789]

I am using Siteimprove for my site but this shop pay link is marked 406 Not acceptable everytime by my crawler.Can anyone help me with this.

This is the link: https://pay.shopify.com/pay/sdk-authorize?analytics_context=loginWithShopPrequal&analytics_trace_id=...

[LitExtension · Accepted solution]

Hi @nr789, the 406 Not Acceptable means Shopify’s server is rejecting the request because your crawler’s Accept header is asking for a content type that link doesn’t provide. Shop Pay pages are not meant for crawlers to parse.

Why this is happening? Shop Pay SDK endpoint behavior, it's meant for in-app payment flows, not consumption by generic bots, so no crawler-friendly content is offered.

TL;DR:

• The crawler isn’t broken, you’re poking a shop-only payment link.
• Shopify wisely blocks non‑authorized, non‑session bots with a 406.
• Just exclude the endpoint from your crawl, problem solved.

That's all. If you find it helpful, please like and mark Solved.