Here's my thoughts.
When did the deed transfer take place?
If it was before your loan it would be a HI loan.
If the deed transferred as part of your transaction then the son and daughter-law purchased the property for the cost of the refinancing.
The opinions expressed are mine and they are not to be taken as legal advice.