I'd say- if he can't take them the days you guys agreed on- then he isn't holding up his end of the time- I woudn't let them go, if it were me, if he can't get them back to you for YOUR time. moms need their time as much as the fathers. and I also agree with you- it wouldn't kill HIM either.