I understand. In this case, I don't have the borrower's SSN, so I don't have a completed application either way. In this particular instance, I was out of the office yeterday, and returned to a message to call the borrower back regarding a refinance, and I have no desire to work with this person for personal reasons.
Unless you own the bank, you don't get to not do business based on personal reasons.
And unless you want this backfiring on you big time, you'd best be going to your boss or the bank president to explain what you want to do and why. Be prepared for them to tell you to do it anyway, too.