I'm just curious, if the only prereq you have left is o-chem, how will you blow through your savings? It sounds like you could work full-time for a year (and keep making payments on your undergrad loans) while finishing up the course.
If you have time, I would try and speak with as many MD's and PhDs as possible. Tell them your dilemma and ask for their insight.
If you can swing it, I'd say go for it. At least try, because 30 years from now you might always wonder "what if." You never truly know with med school- I've seen a number of friends accepted, rejected, rejected and then accepted, or rejected and decided to pursue a PhD or PA school. I think all of them were at least happy that they had given it a real shot.
If I were you - for what it's worth - I would consider taking a research psych job for two years, finish out your prereqs in a year, study for the MCAT/get your application/LORs together, and apply away. Worst case scenario you have two more years or research experience under your belt and can then apply to PhD programs.