Accessing Metafield data through admin api

Got it. In this case the REST metafields API is indeed a bit limited for what you are trying to do. I would highly recommend you trying out GraphQL for your use case – you can pull down all products and the desired metafields through a paginated list, all in one query.