I agree, check with your school and your specific program. In my undergrad, grad students in the College of Music taught the basic music theory and sight singing classes (theory and composition grads), many of the music history sections (musicology grads), some of the non-major music classes (like Modern Popular Music) (ethnomusicology or musicology grads), private lessons (performance grads), etc.
Luckily, with Arts Administration, I'll be working in an office--though two of our assistantships are with the recital halls and as orchestra manager.