You probably figured out a solution by now, but I just spoke to shopify support and found a solution. I noticed it only happened on stores that were password protected. Once I took that off, then it was no longer doing it. Also the icon to schedule will always show there, but if you notice the product doesn’t say preview anymore; it says view. So this means now its available on the online store even though that icon still shows.
Well, if true, that solves my issue. Every collection I create is automatically scheduled to publish on the next half an hour, which is quite frustrating.
Thanks! 
there is no button in my page. like someone hacked me
you are so F-ing right man my trial just ended and now it all started happening
SOLVED! Go to the product section in the sidebar. Check the boxes of the products that are not going live in the online store. Click the 3 dots above and select include in sales channels and make sure online store is checked. Hope that helped!