I would advise against this as well. I had an overseas trip planned for this Feb, and I had to cancel it just a week ago because I was invited for a campus visit and interview to a school that's pretty high on my list. After talking to my professors, they all advised me to postpone/cancel/curtail my trip so that I can be here for the school notifications and in case there will be more campus visits and interviews. We'd miss out on too much if we make a phone interview instead of one in person...
Hope that helps! Also, you might enjoy traveling more when your school plans are all set...