It takes alot of courage to say "you need to leave". But it sounds like he needed to hear it. He cant keep jerking you around like this, it just isnt fair to you or the kids.
Naturally, I hope he has an ah-hah moment after he has moved out and realizes he has to do whatever it takes to GET YOU BACK AND REGAIN YOUR TRUST, but for now it seems like you telling him you wont be treated this way is the best approach.
Hang in there, Juliemam