You summed up my feelings nicely.
I tend to think of cars as a more of a "girlfriend experience." First, there's intense longing and attraction, followed by a lot of great times. As long as the fun factor remains high, we're good to go.
When the inevitable "relationship" issues crop up, I remain patient and hopeful they're just a phase. But when a car becomes a PITA with little hope for change, I'm done, with no looking back. Luckily, I parted ways when I saw the handwriting on the wall, (for the exact reasons you described) and ended the "relationship" on amicable terms before things got ugly.
So while very fond of the XLR, it was far healthier (for my peace of) mind to move on. We remain good friends and focus on the good times.
Like all relationships, some are trouble-free and owner and driver are meant for each other. Many have a love-hate relationship and of course, the worst are when both endure hate-hate relationships and refuse to do anything about it except complain. It's hard to accept change, but at the end of the day, ending a sour relationship is ultimately the best move for both parties. Life is too short and we get to write our own stories (most of the time.)
YMMV,
CC