If your son was threatened then I would say you are correct in bringing son to your place. Flip side is the kid could have just been voicing.
What is dad's plan to deal with the behavior problem. Obviously the kid is distraught about something...the situation, amount of attention, something. Have you discussed it with dad?