We are in a farming community and have this same scenario. We look to the purpose of the barn if it is a working farm and farm land adjoins. If the barn is for ag use - tractors, farm animals, etc then it is not HMDA. If the barn is for the farmers "toys", personal workshop, etc - then it is HMDA.