I think what goes around comes around.
This guy didn't love her from the beginning and didn't feel the sexual attraction even sleeping with her alone in a room. The guy will have affairs sooner or later, when he meets with someone reminds him of the beauty. Because he didn't end up with the beauty, so she will become the most memorable woman in his life forever.
A balanced relationship is the best relationship.