Bing Webmaster Sitemap Failure

[Mount_Republic_]

Hi,

Has anyone successfully submited their sitemap to bing webmaster?

I have submitted it several times over the last few months and for a long time it was pending. Finally, this past month the status turned to "failed".

I fetched the sitemap as a bing bot and this is what the status comes up as: "Status: The DNS resolution for the host of the url (or the redirected url) could not be resolved."

Anyone else have had this issue? And if so, what have you done to fix it?

Thanks,

Matt

[Mount_Republic_]

---

@BrentA wrote:

For the ones having the issue is your www   CNAME in your DNS set to shops.myshopify.com or something else like @ ?

---

I have my domain through shopify, and yes, CNAME RECORD is as follows (Name: www ) and (points to: shops.myshopify.com).

[Mount_Republic_]

---

@Doug_Gorman wrote:

One more time, I called shopify, they said there was not problem. Just realized that when bing reads the xml file there is no format on the site map.....

This XML file does not appear to have any style information associated with it. The document tree is shown below.
        

---

This is normal. There isn't have to be any styling here. XML is simply a file for to allow search engine crawlers to crawl and index your website. 

If I type my link to direct me to the sitemap.xml this is what I get:

This XML file does not appear to have any style information associated with it. The document tree is shown below.

"<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">

<!--

This is the parent sitemap linking to additional sitemaps for products, collections and pages as shown below. The sitemap can not be edited manually, but is kept up to date in real time.

-->

<sitemap>

<loc>

https://www.mountrepublic.com/sitemap_products_1.xml?from=1504400441403&to=1622977937467

</loc>

</sitemap>

<sitemap>

<loc>https://www.mountrepublic.com/sitemap_pages_1.xml</loc>

</sitemap>

<sitemap>

<loc>

https://www.mountrepublic.com/sitemap_collections_1.xml

</loc>

</sitemap>

<sitemap>

<loc>https://www.mountrepublic.com/sitemap_blogs_1.xml</loc>

</sitemap>

</sitemapindex>"

[Mount_Republic_]

---

@Doug_Gorman wrote:

Still now clue as to what is happeinging. Godaddy again was no help. I did figure out that when I submit my site map via Bing Bot using http://ultra45.com I get the Re-Direct to Https, and bing is working!!!  However it is once the re-direct poits to the ssl [https://ultra45.com] the problem occours.

---

I've noticed if I fetch the "http://" link then I get the same status as you. However, when I do it with "https://" the status is "completed".

[GinaYAAHealth]

Are you all still having trouble with this? I am having the same issue with Bing not indexing the site.

I have contacted bing and shopify. I have referred the shopify support tech to this forum case. I will be sharing Bing results with Shopify support to be refered to Tech at Shopify. Hopefully we can get this fixed.

[Jpatrickm]

I've been getting the 403 Forbidden error for awhile but I was able to finally get this working by submitting the non-secure version of my site http:// without the www. No idea why that works, but it did.

[codecreate]

It's the same for me and I am not a newbie. I already host custom ecom sites I made from scratch on Google Cloud. This bug with Bing and Shopify has been going on for what seems like years from the posts in these forums. Each does nothing and each blames each other. I am with 123-reg for my domains so not godaddy like many. 

I suspect the issue is DNS / Cloudflare related with SSL. When using the tools 'Fetch as Bingbot' it works fine, even when using cURL on the command line with 'Bingbot' as the user agent it still returns a 200 status but when submitting sitemaps and pages with https in Bing Webmaster tools it gives 403 errors. Obviously Google Search Console is perfectly fine so the error / bug is probably be more Bing related but don't expect anything other than pre-templated replies from Bing and silence from Shopify.

My store for my client is ranking in Google, all is fine, only the homepage is in Bing, yet I have over 50 other non-shopify sites all ranking and indexed as expected with Bing.

I would suspect many Shopify owners who don't do any web dev won't even know this or be monitoring but it really is beyond a joke and certainly will be meaning I never go past one shop on this platform. It's Bing and Yahoo remember, I know Google is the majority but you least expect to have Shopify sorting this out directly with Bing.

It is very disappointing indeed, I wasted over a day trying everything and anything to no avail. 

http:// submits OK but the pages in the sitemap are https so it's a waste of time. I am waiting to see how manually submitted http versions pan out. The fact we can't even edit our sitemaps and add in internationalised pages with hreflang is also rather weird to say the least. 

It is only a time issue that is preventing me rolling out my own for this particular client. I don't know how anyone can recommend Shopify while this issue is left unattended and ignored.

[vapecommerceuk]

Also having a problem with Bing Webmaster Tools, I cannot verify the domain... I will try again later in case of a temporary problem or timeout.

[codecreate]

That is usually a DNS CNAME issue, might just take some time to propagate. If you are still stuck let me know, I can send a screen shot of my DNS if it helps

[i0nkol]

send shot please

[DabDude]

Any updates on this I am having the same issue all was fine until i migrated to shopify

[codecreate]

After weeks and weeks I now have 7 urls for this site listed in Bing. The only way it seems to work is by manually submitting URLs using http:// instead of https:// even then 7 urls compared to 300 in Google is beyond a joke.

Once again, the issue only occurs with the 1 Shopify site I have. All others are perfectly fine, I have been a web dev for almost 20 years so it's not like I don't understand it. My other sites all rank very well and all crawl without any issues in Bing.

This is obviously a Bing + Shopify + Cloudflare issue or some combination of those three +- one. I wasted days on this and refuse to keep wasting time on bugs I can't fix. Sadly this is one of the downsides of using a hosted platform.

On my other sites I have built and watch over Bing traffic is very low anyway compared to Google, especially UK sites. 5% and this is a not a Shopify site.

[DabDude]

I was thinking about flipping DNS from Godaddy to CloudFlare and just use the free account to see if anything changes or using Linode DNS because i have a couple of boxes there and they offer DNS... Right now I am still having issues with verifying my site by TXT record with Google Webmaster Tools. It just constantly goes to Unsuccessful which i thought it was odd. Its been days and still same message - https://www.screencast.com/t/pOLsPTrtbkFP

Edit: Just Cloudflard DNS Only

[codecreate]

I tried Google DNS, no changes with Bing, Cloudflare might be an option actually if that is the issue, please let us know, thank you.

As for google verification here is my setup below for this shopify site, apologies for scrubbing parts out but you can't be too careful. Maybe this might help you with the Google TXT verification, notice I put it in * and www and @ . 

[DabDude]

alll good thanks again, I will keep you updated!

[codecreate]

Now done, sorry I missed this reply.

[codecreate]

Bing has crawled the site from going by the Index Explorer, it just seems to be very slow showing them up when using the site: operator. So submitting the pages with http:// does seem to have worked. 

I used cURL eg :

curl --head --user-agent "BingBot" https://www.spiceapparel.co.uk

and the response was correct, 200 returned (see below) so the https issue seems like it is Bing Webmaster Tools specific and not bing or bingbot

HTTP/2 200 
date: Mon, 08 Jul 2019 16:39:15 GMT
content-type: text/html; charset=utf-8
set-cookie: __cfduid=db95960f831ae9b739af927e81b80faf71562603955; expires=Tue, 07-Jul-20 16:39:15 GMT; path=/; domain=.www.spiceapparel.co.uk; HttpOnly
x-sorting-hat-podid: 83
x-sorting-hat-shopid: 7153680468
x-frame-options: DENY
x-shopid: 7153680468
x-shardid: 83
content-language: en
strict-transport-security: max-age=7889238
x-alternate-cache-key: cacheable:2629dfd6ec48aa4cf7e9c767b50606d6
x-cache: miss
set-cookie: _shopify_y=7d588732-ed75-4696-a040-cb22d7e7d368; path=/; expires=Thu, 08 Jul 2021 04:17:39 -0000
x-request-id: 5f4f688d-77a1-4bdb-9cb9-7ab6bc8fe294
x-shopify-stage: production
content-security-policy: block-all-mixed-content; frame-ancestors 'none'; upgrade-insecure-requests; report-uri /csp-report?source%5Baction%5D=index&source%5Bapp%5D=Shopify&source%5Bcontroller%5D=storefront_section%2Fshop&source%5Bsection%5D=storefront&source%5Buuid%5D=5f4f688d-77a1-4bdb-9cb9-7ab6bc8fe294
x-content-type-options: nosniff
x-download-options: noopen
x-permitted-cross-domain-policies: none
x-xss-protection: 1; mode=block; report=/xss-report?source%5Baction%5D=index&source%5Bapp%5D=Shopify&source%5Bcontroller%5D=storefront_section%2Fshop&source%5Bsection%5D=storefront&source%5Buuid%5D=5f4f688d-77a1-4bdb-9cb9-7ab6bc8fe294
x-dc: gcp-us-central1,gcp-us-east1
set-cookie: _orig_referrer=; Expires=Mon, 22-Jul-19 16:39:15 GMT; Path=/; HttpOnly
set-cookie: secure_customer_sig=; path=/; expires=Fri, 08 Jul 2039 16:39:15 -0000; secure; HttpOnly
set-cookie: _landing_page=%2F; Expires=Mon, 22-Jul-19 16:39:15 GMT; Path=/; HttpOnly
set-cookie: cart_sig=; path=/; expires=Mon, 22 Jul 2019 16:39:15 -0000; HttpOnly
nel: {"report_to":"network-errors","max_age":2592000,"failure_fraction":0.01,"success_fraction":0.0001}
report-to: {"group":"network-errors","max_age":2592000,"endpoints":[{"url":"https://monorail-edge.shopifycloud.com/v1/reports/nel/20190325/shopify"}]}
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
server: cloudflare
cf-ray: 4f337e3eec473516-LHR

[altCookinghub]

Hi, I'm a newbie particularly on this SEO and indexing subjects.

Do I understand your latest post correctly that it is equivalent and working to submit the sitemap using http:// instead of https:// because using https:// will actually result in 403 error? Please kindly share. Thank you in advance.

[EUGENEAR]

Bing it is showing 403 (Forbidden)

is shopify or cloudflare blocking bing bots by mistakes?

[altCookinghub]

Eugene, I don't know. How do one verify and confirm that?

Thank you for your input and guide.

[codecreate]

altCookinghub - yes that is correct, submit http://  sitemaps and urls, it seems to be the only workaround.