Which company provide such option?
Since Latvia is a European country you can use all the services that support the EU. Afterpay and Affirm are the leading service providers I have worked with.
They do not provide services registered in Latvia
Stripe supports. Here is the answer > https://community.shopify.com/post/2830091