It's a questionable business practice, but there's no violation of Reg. Z and it's not likely there's a state law that prohibits the practice, either.
The argument that the practice is abusive is a very long stretch--for each 1% the IR might be reduced per $100,000 refinanced, the borrower's interest differential is only $2.74. On the other hand, I don't have to make the case that a cooling-off period is a good thing--because Congress did that when enacting TILA. Who's to say that 3 days is better than 4? In 1968, Congress thought 3 was sufficient, but maybe my customers are a bit slower than average.
If you could know the origin of your 4 day rescission policy, it's probably a kneejerk reaction to ancient violations involving shorter periods. Whoever was in charge at the time declared - "that'll never happen again if we go to 4 days." After a few years, the practice rose to the unquestionable status of "we've always done it that way."
_________________________
...gone fishing.