404 Page Errors for Pages that Don't have an Obvious Redirect

[Meeshthedog]

We recently migrated from Wordpress Woocommerce to Shopify and have encountered some page indexing issues that we have quickly remedied using redirects. That said, we also have a number of urls that have no obvious redirect and are Wordpress Woocommerce specific. How can we disclude these urls from being crawled and eliminate these 404 errors?

[NomtechSolution]

To exclude specific URLs from being crawled by search engines and eliminate 404 errors for your old WordPress WooCommerce URLs, you can follow these steps:

1. Create a robots.txt file: In your Shopify admin, go to "Online Store" > "Preferences" > "Search engines." Scroll down to the "Edit robots.txt" section and click on "Create robots.txt file." This file tells search engine crawlers which pages to crawl and which to exclude.

2. Exclude URLs in robots.txt: Open the robots.txt file and add rules to exclude the specific URLs that are generating 404 errors. For example, if you want to exclude the URL "/old-product-url" from being crawled, add the following line:

Disallow: /old-product-url

[Meeshthedog]

Thank you for your reply however this did no resolve the issue as "search engines" is not an available option under preferences. 

"Online Store" > "Preferences" >  "Search engines."

[Meeshthedog]

What worked ....

Themes > Edit Code > Add New Template > Select Robot.txt in dropdown > Disallow: /old urls