I think that the guy realized that him and his girlfriend aren't quite ready for a serious relationship. Like, he'd wanted to be with her and date her for awhile, but when he does, he realizes that it's not all it's cracked up to be. The idea of them being together seemed great, all peaceful and perfect, a type of "heaven". But when their actually a couple, it's not at all what he'd expected. Maybe he's tired of the same thing? Maybe they've lost that "loving feeling" or passion? -_- So he thinks they should move on. What he's trying to say is that old breakup cliche' "It's not you, it's ME" ;) When he says "Take me back inside when the time is right" I think it refers to when and if he's ever ready for the serious relationship with her. So obviously he still cares for her, he just realizes their not ready for a serious relationship. That's what I think, at least.
Avenged Sevenfold ftw! Love this song. ; D