Caregiver being called a charmer. Is this an insult?

Recently my client has decided to switch to isted living and I am being told by a member of her family that I "have been quite a charmer". I feel this may have been meant as an insult as it was stated in a somewhat coy, insincere manner. I feel that I have done everything right as a new caregiver (I don't have tons of experience but I don't think I'm bad at it) and I don't deserve to be treated this way. Do you think this is an insult and if so what should I do?