I have seen numerous posts about this and some get the issue fixed and some don't. I have followed he advice given by many and appear to be pretty close.
So It appears to be partially working. It removes the sizes that aren't available for the default selected variant, but it applies it to all variants despite them having that size. So for example my first variant only comes in Medium, now all variants only have medium as their option.