Bing Webmaster Sitemap Failure

[Mount_Republic_]

Hi,

Has anyone successfully submited their sitemap to bing webmaster?

I have submitted it several times over the last few months and for a long time it was pending. Finally, this past month the status turned to "failed".

I fetched the sitemap as a bing bot and this is what the status comes up as: "Status: The DNS resolution for the host of the url (or the redirected url) could not be resolved."

Anyone else have had this issue? And if so, what have you done to fix it?

Thanks,

Matt

[Mount_Republic_]

Hey all,

So I've heard from bing. Apparently they weren't able to reproduce my DNS failure. They took a look at it and from what they see is that on the back-end bing is able to get to the sitemap, but for whatever reason it isn't getting updated on the webmaster portal. They have manually resubmitted my sitemap and will follow up with me. So far, my website hasn't been indexed so we'll see...

Have you guys verified your domain through bing? 

Shopify got back to me as well. So far all they've recommended is (1) to make sure the website is verified on Bing (which it is already) as well as offered a link to purchase a shopify app that can help with verification (don't need it), and (2) to use this forum as guidance (no help there as I'm the one who opened this thread..............).

-Matt

[Mount_Republic_]

---

@BrentA wrote:

For the ones having the issue is your www   CNAME in your DNS set to shops.myshopify.com or something else like @ ?

---

I have my domain through shopify, and yes, CNAME RECORD is as follows (Name: www ) and (points to: shops.myshopify.com).

[vapecommerceuk]

Also having a problem with Bing Webmaster Tools, I cannot verify the domain... I will try again later in case of a temporary problem or timeout.

[codecreate]

That is usually a DNS CNAME issue, might just take some time to propagate. If you are still stuck let me know, I can send a screen shot of my DNS if it helps

[i0nkol]

send shot please

[DabDude]

Any updates on this I am having the same issue all was fine until i migrated to shopify

[codecreate]

After weeks and weeks I now have 7 urls for this site listed in Bing. The only way it seems to work is by manually submitting URLs using http:// instead of https:// even then 7 urls compared to 300 in Google is beyond a joke.

Once again, the issue only occurs with the 1 Shopify site I have. All others are perfectly fine, I have been a web dev for almost 20 years so it's not like I don't understand it. My other sites all rank very well and all crawl without any issues in Bing.

This is obviously a Bing + Shopify + Cloudflare issue or some combination of those three +- one. I wasted days on this and refuse to keep wasting time on bugs I can't fix. Sadly this is one of the downsides of using a hosted platform.

On my other sites I have built and watch over Bing traffic is very low anyway compared to Google, especially UK sites. 5% and this is a not a Shopify site.

[DabDude]

I was thinking about flipping DNS from Godaddy to CloudFlare and just use the free account to see if anything changes or using Linode DNS because i have a couple of boxes there and they offer DNS... Right now I am still having issues with verifying my site by TXT record with Google Webmaster Tools. It just constantly goes to Unsuccessful which i thought it was odd. Its been days and still same message - https://www.screencast.com/t/pOLsPTrtbkFP

Edit: Just Cloudflard DNS Only

[codecreate]

I tried Google DNS, no changes with Bing, Cloudflare might be an option actually if that is the issue, please let us know, thank you.

As for google verification here is my setup below for this shopify site, apologies for scrubbing parts out but you can't be too careful. Maybe this might help you with the Google TXT verification, notice I put it in * and www and @ . 

[DabDude]

alll good thanks again, I will keep you updated!

[codecreate]

Now done, sorry I missed this reply.

[codecreate]

Bing has crawled the site from going by the Index Explorer, it just seems to be very slow showing them up when using the site: operator. So submitting the pages with http:// does seem to have worked. 

I used cURL eg :

curl --head --user-agent "BingBot" https://www.spiceapparel.co.uk

and the response was correct, 200 returned (see below) so the https issue seems like it is Bing Webmaster Tools specific and not bing or bingbot

HTTP/2 200 
date: Mon, 08 Jul 2019 16:39:15 GMT
content-type: text/html; charset=utf-8
set-cookie: __cfduid=db95960f831ae9b739af927e81b80faf71562603955; expires=Tue, 07-Jul-20 16:39:15 GMT; path=/; domain=.www.spiceapparel.co.uk; HttpOnly
x-sorting-hat-podid: 83
x-sorting-hat-shopid: 7153680468
x-frame-options: DENY
x-shopid: 7153680468
x-shardid: 83
content-language: en
strict-transport-security: max-age=7889238
x-alternate-cache-key: cacheable:2629dfd6ec48aa4cf7e9c767b50606d6
x-cache: miss
set-cookie: _shopify_y=7d588732-ed75-4696-a040-cb22d7e7d368; path=/; expires=Thu, 08 Jul 2021 04:17:39 -0000
x-request-id: 5f4f688d-77a1-4bdb-9cb9-7ab6bc8fe294
x-shopify-stage: production
content-security-policy: block-all-mixed-content; frame-ancestors 'none'; upgrade-insecure-requests; report-uri /csp-report?source%5Baction%5D=index&source%5Bapp%5D=Shopify&source%5Bcontroller%5D=storefront_section%2Fshop&source%5Bsection%5D=storefront&source%5Buuid%5D=5f4f688d-77a1-4bdb-9cb9-7ab6bc8fe294
x-content-type-options: nosniff
x-download-options: noopen
x-permitted-cross-domain-policies: none
x-xss-protection: 1; mode=block; report=/xss-report?source%5Baction%5D=index&source%5Bapp%5D=Shopify&source%5Bcontroller%5D=storefront_section%2Fshop&source%5Bsection%5D=storefront&source%5Buuid%5D=5f4f688d-77a1-4bdb-9cb9-7ab6bc8fe294
x-dc: gcp-us-central1,gcp-us-east1
set-cookie: _orig_referrer=; Expires=Mon, 22-Jul-19 16:39:15 GMT; Path=/; HttpOnly
set-cookie: secure_customer_sig=; path=/; expires=Fri, 08 Jul 2039 16:39:15 -0000; secure; HttpOnly
set-cookie: _landing_page=%2F; Expires=Mon, 22-Jul-19 16:39:15 GMT; Path=/; HttpOnly
set-cookie: cart_sig=; path=/; expires=Mon, 22 Jul 2019 16:39:15 -0000; HttpOnly
nel: {"report_to":"network-errors","max_age":2592000,"failure_fraction":0.01,"success_fraction":0.0001}
report-to: {"group":"network-errors","max_age":2592000,"endpoints":[{"url":"https://monorail-edge.shopifycloud.com/v1/reports/nel/20190325/shopify"}]}
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
server: cloudflare
cf-ray: 4f337e3eec473516-LHR

[altCookinghub]

Hi, I'm a newbie particularly on this SEO and indexing subjects.

Do I understand your latest post correctly that it is equivalent and working to submit the sitemap using http:// instead of https:// because using https:// will actually result in 403 error? Please kindly share. Thank you in advance.

[codecreate]

altCookinghub - yes that is correct, submit http://  sitemaps and urls, it seems to be the only workaround.

[Astha]

Hello Matt,
Try following bing tools to get the exact solution of your query
    1- Fetch as Bingbot
    2-Markup Validator
    3-SEO Analyzer
The DNS resolution for the host of the URL (or the redirected url) could not be resolved." this status can be because of the wrong url, your server is not responding, your URL is expired, etc
Contact your server team to resolve this issue
rest refer this https://www.bing.com/webmaster/help/why-is-my-site-not-in-the-index-2141dfab

thanks!

[codecreate]

This issue is most likely Shopify or Cloudflare blocking IPs used by Bing Webmaster tools.

Google Search Console uses IP's for it's search console which show as Google Cloud customer IP's. When many people are submitting URL's via GSC or Bing Webmaster tools, using many IP's for load balancing it is easy for Cloudflare or Shopify to block those IP's assuming they are malicious.

This error is not Shopify customer error, it is Cloudflare or Shopify. Sadly both companies refuse to acknowledge this issue let alone fix it. 

[DabDude]

I flipped my dns over to cloudflare from godaddy and only using dns I am able to register my txt record now. Still won't crawl bing https

[codecreate]

---

@DabDude wrote:

I flipped my dns over to cloudflare from godaddy and only using dns I am able to register my txt record now. Still won't crawl bing https

---

No it won't, use http . Shopify should resolve this but they don't seem bothered at all which I find rather unusual. I suppose help reps with no technically knowledge won't have a clue, it should be passed up the food chain though.