Filtering Available variant color swatches

Hello,

I currently use a theme that has variant color swatches on the collections/catalog pages (theme is Prestige version 6.0.0). My products only have 1 variant, which is color, so the color swatch feature is very useful.

I regularly have inventory of certain colors of various products, but not all the colors at once. How can I make it so that a customer using the catalog filters can filter for Availability, and the color swatches for out-of-stock colors are hidden from the catalog page color swatch?

Currently, it will show all products (and all color swatches under each product) as long as at least 1 color is in stock, which basically doesn’t filter anything away because I have at least 1 color in stock for each product at most times)

Thank you in advance!