Depends on why. If the wives leave them and they are still in love with them, then yes. But if she's controlling and nasty, you'd be much happier hitting the road.

Also with a good wife and self-respecting guy, you don't have to make a choice at all. She would respect your freedom to listen to what you want and vice versa.