Please select the style to "Image with play button" in video section settings.
If helpful then please Like and Accept Solution. Do you need custom changes on store ? Hire us. Feel free to Contact me for shopify help on firstname.lastname@example.org Shopify Design Changes | Shopify Custom Theme Design and Development | Shopify App Development
it's found on the settings tab bottom left. However videos are set with you tube links so I don't see how this will solve the problem. I have the same issue. The youtube video link does not have sound on my shopify page.