As long as you haven't conducted cash transactions over $10,000 with any of them, you haven't violated the regulation by not filing. However, I agree, that it's an easy exemption to file, the risks of missing a potentially reportable transaction are higher, since those transactions usually don't flow through your normal reporting processes, so why not file them.
_________________________
Opinions are mine and not necessarily my employer's.