The song explains a man and a woman in love, and society doesn't like it. He's trying to prove to her that no matter what anyone says, her loves her and that the world (or as it is society) is in fact the ugly one, alongside being close-minded. As in an overaged relationship, he needs to leave her, for both there's sakes. He doesn't want to, but it is what society wants.