Based on what you're telling us here and some of your responses in the comments, I hope y'all decide to seek counseling. Being weary of expressing to your partner how their actions made you feel is not a healthy place to be in a relationship. It only breeds resentment which will just create an even further wedge between you all.
You're not wrong or overly sensitive for feeling how feel. However, not talking to your husband and understanding his intentions will leave you battling with your own conclusions. I really hope y'all can work it out.
Personally, I don't think he meant anything by it even though I do agree that the comment was off putting.
