Not when it's worn/damaged once due to age. Not when they have an unauthorized trans. But repeatedly losing it, yes.
At what point should you consider that having to repeatedly replace lost cards is too costly, and you "Just say no"? Are you not experiencing any unauthorized transactions using the lost cards that may have been found by someone else?