The way I look at it is he's talking about a lover and they just had a bad break up or a falling out. so the person he's talking about will always be a part of him because they left their imprint on him. to me he's saying this person changed his life so much to the point where if they do leave a piece of them will stay with him.