If we could ask the customer for reimbursement of the fees for the loan but if the customer was not willing to pay, would the bank be responsible for the fees?

Yup.....cost of doing business. The only way to guard against that is require customers to pay fees as the fees are billed to the bank prior to closing. No one does that (that I know of).