I believe that the girl was been scarred in a past relationship and the guy is willing to wait for her to realize that he won't hurt her like the other guy (first stanza). But it doesn't help that people discourage her from dating him. He tells her not to let the world get to her, the relationship is between her and him(we don't need the world right now). He tells her she is worth is time (all I need is u). I think this song is really sweet. :)