PayPal appears as only payment method when my customers try to purchase from my store

True, but you have to activate it