Why are you concerned about grandma taking the children out of the state for a vacation? You should check yourself to determine whether you are trying to be controlling or whether you have legitimate concerns.
By the way, I agree with your Judge, fathers should be involved in raising their children. . . .just like mothers.
Without more inmformation, it seems to me that you are out of line here.