" . . .the courts stated that I haven't let it go and they feel that because I still have anger in my husband cheating on me that I couldn't raise my boys."
I am sure that there is far more to this story than meets the eye. My impression is that your reaction to your husband's behavior was extreme and involved your children. Were any evaluations performed? Have you gone to counselling to address your anger issues?