Kids don't like a lot of things. Sadly it may be a symtom of the overall situation between the households. Once again, there is nothing you can do about the other househild so maybe trying turning it into a positive.
besides, you and hubbie need time away as well...who wants to have the kids 10% of the time, no break at all. It take both parties to raise the child(ren). Don't forget that...