lilmama, why the restraining orders? Are they simply orders banning you from moving the kids out of town? If so, that is not unusual in a move-away case. Moving with the children can often cost a custodial parent custody.
Or are the restraining orders for some other purpose? The drug accusation?
This could be a tough one for you. You moved and the fact that the father now has the child and an RO on you doesn't sound good. He will need to show evidence of drug use.