I'm 23 and my wife is 25. We have a two year old little boy and a four month old little girl. We will be making a move for sure this August for a PhD program in English (unless I get rejected across the board, of course).
We're both from Texas, and about a year and a half ago we made the move to Oxford, UK, where I got my Master's degree. My son was 6 months old at the time, and the move was somewhat stressful with him in tow. However, we survived.
This time around, we will be making a move within the States, so it should be much easier relocating. There is another child involved, however, so that might make things more difficult.
All in all, however, I think all of us with families will survive, regardless of how many times we feel like pulling our hair out or giving up.