"Go get your shovel (You'll be better off without me) And we'll dig a deep hole To bury the castle (ooh), bury the castle Go get your shovel (You'll be better off without me) And we'll dig a deep hole To bury the castle (ooh), bury the castle" This is where you go through a piece by piece dismantling of your guilty world. It's like hell on earth, there's no other way I can think of to describe it. The brick by boring brick is the rebuilding. The rest of the song I find less difficult to understand. I think it is about a woman who is struggling to accept her sinful nature. She is probably quite creative and needs to understand that this creativity is a blessing and not a curse. She needs to realise that she is allowed to use this creativity in the brick by brick rebuilding process without shame, and in that way the path will seem less boring and become more pleasurable for her (In my opinion).