It is always scary to start a new position.... whether in a university or for a job. You dont really know all of the pros and cons until you are in it. Here are some stories about people who had bad advisors:
http://www.biotechboards.com/showthread.php?t=4879