I think at this point you should really re-evaluate yourself.
If you are having so much trouble in your Masters program right now, do you think you'll do well in a PhD program?
Even if you pass all the classes and other requirements to graduate, do you think you'll be competitive enough to compete with other people with the same degree?
I was a Physics BA with a minor in math/comsci, having taken 0 geology classes and I am doing fine. I think i am probably the only one who has gotten A's in all of the geophysics grad classes here, though I got a few Bs in normal geology classes. Don't worry about your background. Its much easier to make a mathematician a geophysicist than a geologist a geophysicist.
The people I know with pure math backgrounds went into atmospheric sciences, but i think its the same case. Most of your geophysics classes will only touch on Linear Algebra, V-Calc, and PDEs. They probably won't even have you solve them, just want you to be aware of the ideas ( such as tensors/focal mech) ect. Most of the advanced stuff you do will be in your research, where you should be able to pick up anything you know.
I even taught Intro geology without taking the class before.... its really NO BIG DEAL. It sounds like you have a stronger geology background that I have (i doubt i could identify rocks, minerals, though I know there properties and how they interact with tectonics n such).
Suffice to say, I found that my MSc coursework has been significantly easier than the upper level physics and math courses (such as real analysis, complex, Advanced Linear). I am sure you will do fine, most geology students aren't as strong as they need to be in math and physics until later on in their career, and thats basically what the MSc is designed to do; teach you some technical stuff and adress the weaknesses in your education while giving you research experience That way it provides you a good background to A) Go into industry or Go to PhD.