Well from the sound of it your marriage isnt on the right foot anyways. If you are keeping a secret like this then something is not right. With a comment like "he doesnt notice me much anymore" makes me think you guys are having trouble. I think you should tell him, like someone else said dont ask, just tell. If he doesnt like it then oh well. This about you and your life not him.
If I am wrong in my assumptions than I apologize or if you need someone to listen PM me.