I agree. I find that Fitz only needs her to fill in some inadequate part of his life. It's just not healthy. Jake, on the other hand seems to keep her grounded.
To be honest I gradually moved from Team Liv to Team Mellie as I got deeper and deeper into the show. I think Olivia receives too much regard for what she does as opposed to Mellie who is cut very little slack throughout the show.