Bing Webmaster Sitemap Failure

Excursionist
14 0 3

After weeks and weeks I now have 7 urls for this site listed in Bing. The only way it seems to work is by manually submitting URLs using http:// instead of https:// even then 7 urls compared to 300 in Google is beyond a joke.

 

Once again, the issue only occurs with the 1 Shopify site I have. All others are perfectly fine, I have been a web dev for almost 20 years so it's not like I don't understand it. My other sites all rank very well and all crawl without any issues in Bing.

 

This is obviously a Bing + Shopify + Cloudflare issue or some combination of those three +- one. I wasted days on this and refuse to keep wasting time on bugs I can't fix. Sadly this is one of the downsides of using a hosted platform.

 

On my other sites I have built and watch over Bing traffic is very low anyway compared to Google, especially UK sites. 5% and this is a not a Shopify site.bing.png

 

0 Likes
Tourist
4 0 3

I was thinking about flipping DNS from Godaddy to CloudFlare and just use the free account to see if anything changes or using Linode DNS because i have a couple of boxes there and they offer DNS... Right now I am still having issues with verifying my site by TXT record with Google Webmaster Tools. It just constantly goes to Unsuccessful which i thought it was odd. Its been days and still same message - https://www.screencast.com/t/pOLsPTrtbkFP

 

Edit: Just Cloudflard DNS Only

1 Like
Excursionist
14 0 3

I tried Google DNS, no changes with Bing, Cloudflare might be an option actually if that is the issue, please let us know, thank you.

 

As for google verification here is my setup below for this shopify site, apologies for scrubbing parts out but you can't be too careful. Maybe this might help you with the Google TXT verification, notice I put it in * and www and @ . dns-shopify.png

1 Like
Tourist
4 0 3

alll good thanks again, I will keep you updated!

1 Like
Excursionist
14 0 3

Now done, sorry I missed this reply.

0 Likes
Highlighted
Excursionist
14 0 3

Bing has crawled the site from going by the Index Explorer, it just seems to be very slow showing them up when using the site: operator. So submitting the pages with http:// does seem to have worked. 

 

I used cURL eg :

 

curl --head --user-agent "BingBot" https://www.spiceapparel.co.uk

and the response was correct, 200 returned (see below) so the https issue seems like it is Bing Webmaster Tools specific and not bing or bingbot

 

HTTP/2 200 
date: Mon, 08 Jul 2019 16:39:15 GMT
content-type: text/html; charset=utf-8
set-cookie: __cfduid=db95960f831ae9b739af927e81b80faf71562603955; expires=Tue, 07-Jul-20 16:39:15 GMT; path=/; domain=.www.spiceapparel.co.uk; HttpOnly
x-sorting-hat-podid: 83
x-sorting-hat-shopid: 7153680468
x-frame-options: DENY
x-shopid: 7153680468
x-shardid: 83
content-language: en
strict-transport-security: max-age=7889238
x-alternate-cache-key: cacheable:2629dfd6ec48aa4cf7e9c767b50606d6
x-cache: miss
set-cookie: _shopify_y=7d588732-ed75-4696-a040-cb22d7e7d368; path=/; expires=Thu, 08 Jul 2021 04:17:39 -0000
x-request-id: 5f4f688d-77a1-4bdb-9cb9-7ab6bc8fe294
x-shopify-stage: production
content-security-policy: block-all-mixed-content; frame-ancestors 'none'; upgrade-insecure-requests; report-uri /csp-report?source%5Baction%5D=index&source%5Bapp%5D=Shopify&source%5Bcontroller%5D=storefront_section%2Fshop&source%5Bsection%5D=storefront&source%5Buuid%5D=5f4f688d-77a1-4bdb-9cb9-7ab6bc8fe294
x-content-type-options: nosniff
x-download-options: noopen
x-permitted-cross-domain-policies: none
x-xss-protection: 1; mode=block; report=/xss-report?source%5Baction%5D=index&source%5Bapp%5D=Shopify&source%5Bcontroller%5D=storefront_section%2Fshop&source%5Bsection%5D=storefront&source%5Buuid%5D=5f4f688d-77a1-4bdb-9cb9-7ab6bc8fe294
x-dc: gcp-us-central1,gcp-us-east1
set-cookie: _orig_referrer=; Expires=Mon, 22-Jul-19 16:39:15 GMT; Path=/; HttpOnly
set-cookie: secure_customer_sig=; path=/; expires=Fri, 08 Jul 2039 16:39:15 -0000; secure; HttpOnly
set-cookie: _landing_page=%2F; Expires=Mon, 22-Jul-19 16:39:15 GMT; Path=/; HttpOnly
set-cookie: cart_sig=; path=/; expires=Mon, 22 Jul 2019 16:39:15 -0000; HttpOnly
nel: {"report_to":"network-errors","max_age":2592000,"failure_fraction":0.01,"success_fraction":0.0001}
report-to: {"group":"network-errors","max_age":2592000,"endpoints":[{"url":"https://monorail-edge.shopifycloud.com/v1/reports/nel/20190325/shopify"}]}
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
server: cloudflare
cf-ray: 4f337e3eec473516-LHR
0 Likes
Excursionist
23 0 4

Hi, I'm a newbie particularly on this SEO and indexing subjects.

Do I understand your latest post correctly that it is equivalent and working to submit the sitemap using http:// instead of https:// because using https:// will actually result in 403 error? Please kindly share. Thank you in advance.

1 Like
Shopify Partner
4 0 1

Bing it is showing 403 (Forbidden)

is shopify or cloudflare blocking bing bots by mistakes?

1 Like
Excursionist
23 0 4

Eugene, I don't know. How do one verify and confirm that?

Thank you for your input and guide.

 

1 Like
Excursionist
14 0 3

0 Likes