Jennifer is exactly right. You can but you don't have to. This was a home equity loan. When it is redone (you called it a refinance), it is still a home equity loan. It is not a purchase money, so I don't like calling it a "refinance."
But, you could. In 2004, you must report it, as the definition of "refinance" changes.