I understand your fears, but at the end of the day, it's not like a Ph.D. or masters degree can hurt your chances of doing something else, even if it's in a completely different field. People will just think you're one of those people who wants to understand the world from all its angles, and that's never a bad thing.
Keep in there! I'm freaking out about admissions too, just hoping I get in somewhere.
Grad school isn't a lifetime commitment. I might think that this is EXACTLY what I want to do with the rest of my life, but ten years down the road I might change my mind. We're still young. If you love it now, do it. Leave your future problems to your future self.