Can customers be charged back for credit card fees?

Can the credit card fees be charged back to the customer? There are 3rd party plug-in apps that allow cart fees but they are based on products/collections, not on payment type.