If any amount is used for improvements, refinance or purchase the loan becomes reportable.
And to add to this, if a closed end loan, you would report the full amount of the loan not just the portion of the proceeds for improvement, refinance or purchase.