Are Fair Lending exams ever perform NOT in the context of a 'protected class'? Will a thorough Fair Lending exam scrutinize underwriting 'fairness' in treatment for people from the same class?
Fair lending exams are all about identifying risk. Actual violations really aren't cited as even the DOJ uses phrases like "alledged" as courts are probably the only place a violation could be determined (apart from overt evidence of disparate treatment). Therefore, your examiners will be evaluating your risk for discrimination against a protected class by reviewing you policies, procedures, and controls. As Rocky stated, a lack of defined lending criteria in a policy is a big red flag for fair lending risk. That said, if you are under $45mm in assets (as you said you were too small to be a HMDA reporter), then you probably only have 1 to 3 lenders in the first place. Even if that is the case, you will still want to implement as strong of a control as possible as fair lending is probably one of your greatest compliance risks (it always is).
In my opinion, one of the best ways to reduce your fair lending risk is to create both a formalize exception program and a formalized review of adverse action notices. Doing this will allow your bank to identify gap like you explained previously. In a small bank like yours, it would be ideal to create some sort of "exception council" where all (both) of your lenders get together pro-actively before any exceptions are made. The goal would be to compare the potential exception with past denials and to avoid inconsistencies. To do this, of course, you would need to define your acceptable standards so that you are clear on what needs to go to the group. Apart from that, you could start making group underwriting decisions...
Again, fair lending is a big deal and it sounds like you have a few red flags in your current program.
Good luck.