Coming from a homebody and someone who attended undergrad about two hours away from my home city, go with the fit! Grad school is also about having new experiences and meeting new people. I haven’t decided which school I will be attending (I have two offers) but either way I will be out of state and probably across the country.
Obviously if money is a factor or the school closer to home is a better program than you would want to go there but I don’t think you should go to a school simply because it’s closer to home.
But that’s just me. ?