If I were you, I will choose to divorce with two kids and find my true lover to raise with me. Come on, there are many single moms with two kids. It is not the end of world. The most important thing is giving them a good environment.