Consider just using the court system. If you know he is the father then there is little he can do. I also thought by signing the birth certificate he is acknowledging being the father?
I would not let him know it makes you mad. My ex does things to try to make mad (and she does) and I just blow it off. Just file the motion, don't say anything, and see what happenes.
Mine was the opposite-never married but she would not tell me when, where or sex of child-and told me I would never see him, etc. 5 years later I have 50-50. So, things do change over time.