Yes, you can set up Shopify so that it uses Cash on Delivery. Go to Settings > Payment and find it under "Manual Payments". You don't need to accept credit cards if you don't want to.
Also, check Aramex App here:
Hope this helps.
Cash on delivery can be enabled from the Shopify dashboard under Payments settings. For handling Aramex shipping, you can use the Multi-Carrier Shipping Label app, that will help you automate the complete shipping process.
There are many shipping or fulfillment companies available in UAE like DHL, Aramex, Fedex etc. You can also go for local shipping companies with affordable rates.
SkyEx is one among them - https://www.skyexpressinternational.com/
They also have Shopify App for fulfillment : https://apps.shopify.com/skyex-shipping-app-dubai