I have been trying to optimize website server response time without success.
Finally, I decided to test robots.txt server response time for several Shopify-hosted stores.
All these domains are configured with the same DNS server provider. so the DNS response time is not a factor.
What I found is there are two speed categories
1- The server returned robots.txt in an average of 10 ms
2- Other slower servers returned robots.txt in an average of 25 ms
Since robots.txt is not associated with any liquid. This is clearly associated with the quality of the server where Shopify hosts the domain.
If there is such a large time difference in returning robots.txt. It’s safe to conclude this speed difference will be amplified when a slow server starts to execute liquid.
Any comments or ideas?