It may be unwelcome advice, but choosing a grad program on the basis of the size of the stipend is short-term thinking.
When I was admitted to grad school, I had several choices (yeah, I know), but one top choice offered me $X, and another offered me $3X, literally three times as much money. I chose $X, and it was absolutely the right decision. Yes, my grad years were leaner than they could have been, and yes, it was a serious struggle. But because the low-paying program was a better fit, offered better opportunities, and offered extraordinary peers, it was the right long-term choice.
So yes, pay attention to the offers, and yes, pay attention to cost of living.
But keep in mind your values, and why you're going to grad school, and what you hope to get out of it.
(In case anyone wants to charge me with privilege, current grad students make 150% - 250% of what I and my peers made as stipends--after adjusting for inflation/COL. It wasn't easy then and it's not easy now, but it's doable for most of us.)