Someone just shared a solution with me. Apparently, you get them with the Assets API: https://shopify.dev/docs/api/admin-rest/2023-07/resources/asset#get-themes-theme-id-assets
But I don’t know if this will actually work. I guess the template prefix would be part of the key value?