This type of thing is discussed in internal controls guidance from the agencies. For a very small bank, that solution would be workable. He doesn't co-approve any loans, does he?
A good process with compensating controls will be adequate.
I think the question would be who will collect his loans? Is there someone else qualified, such as a senior lender?