I did my undergrad at Scripps - albiet a few years ago, so some things have changed.
Claremont is great, but fairly expensive. "The Village" - as the quaint little shopping area is known - has some great restaurants, and some cute shops, but again fairly expensive. A lot of the houses near the colleges are owned by faculty, the colleges, or wealthy private citizens. Check then housing/apartment listings for the 91711 zip code to see what houses within walking distance are going for.
When I was there, I heard a few grad students complain about the grad student housing.....but they may have redone it since I graduated. There are good places to live around there - both affiliated with the colleges and private. I would say check north of Foothill. I had some friends who rented a single family home up there for fairly inexpensive.
There are areas nearby that are not great, but you aren't really going to encounter them unless you drive to them. Like most LA suburbs the area is sprawling, so as long as you know what to avoid - and it will become clear - you should be good.
Let me know if you have any specific questions and I'll try to answer them.