How to manage duplicate products with variants, images, and different discount prices?

Hi everyone,
We currently have 2000+ products in our Shopify store. Each product has 5 variants and different discounted prices based on the variant.
The issue we’re facing is that some products are getting duplicated in the store. The duplicates are inconsistent for example:

  1. Some duplicate products have images but no discounted pricing
  2. Some have discounted pricing but missing images
  3. Some are completely incomplete (no images or pricing)

Because of the large number of products, it’s becoming very difficult to manually identify and clean up these duplicates while keeping the correct images, descriptions, and variant pricing.
I’d like to ask:

  1. What’s the best way to identify duplicate products in Shopify at scale?
  2. How do you prevent duplicates from happening again when importing or updating products?

Here is the file link:

For testing purpose we just add few items there.
Thanks
Sam

Duplicates won’t happen on their own, there must be some process or app you’re using that’s creating them. For example, if you’re using product imports by spreadsheet you could be missing key columns when you import.

From Shopify documentation:

“When you import a CSV file, you can select the option Overwrite products with matching handles. If you select this option, then when the handle in the import CSV file matches an existing handle in your products list, the values in the CSV file overwrite the values in the matching columns in the existing product list. If the overwrite option isn’t selected, then the products that match an existing handle are ignored during CSV import.”

https://help.shopify.com/en/manual/products/import-export/using-csv#overwriting-csv-file

Since you have variants, you also need to include the variant 1 name, variant 1 value, variant 2 name, variant 2 value and variant 3 name and value.

“If you don’t include the Option1 name and Option1 value columns, then a new default variant is created and existing variants are deleted.“

https://help.shopify.com/en/manual/products/import-export/using-csv#overwriting-csv-file

For cleaning them up, I would suggest:

  • Export products
  • Identify the duplicates you want to remove
  • For those products, update the Tags column to include a tag like “DUPLICATE-REMOVE” or whatever you want
  • Import just the product key identifiers (handle, variant info) and the tags column, to update the tags only
  • In Shopify admin, in Products, filter for products with the new tag
  • Select all those products
  • Do a bulk action to delete them. https://help.shopify.com/en/manual/shopify-admin/productivity-tools/bulk-actions

Hi,

Hope this will help

  • Export your full catalog and treat the CSV as your cleanup workspace.
  • Use handles, SKUs and titles to detect duplicates with filters and pivot tables, identify the complete product version and re-import a cleaned file.
  • To prevent future duplicates, keep handles and SKUs stable, update existing products instead of recreating them, manage everything from a single master spreadsheet and run regular audits.

This turns a manual cleanup problem into a repeatable system.

Thank you @All for your response.I appreciate your help

AI Hero could probably help to detect and deduplicate your products.