ok.
So for me, the issue was because koa-shopify-auth defaults the host of the redirect URL to the host of the request.
This host is changed by the reverse proxy. For me, I had to configure Nginx myself for it to work.
I also opened an issue to make this configurable.