IMO, you've thought about just the right amount. Your reasoning seems sound to me. As noted above, whether or not you have a credit decision is based on your own procedures. As long as a "refer" decision by your automated system requires additional action, you do not have a credit decision yet, and a customer withdrawal should be recorded as that on the HMDA LAR.
_________________________
The opinions expressed here are personal and do not represent opinions of my employer.