Sometimes, if a song is written, in essence, to be that stripped down, it's very touchy when you start adding things, because even the smallest thing can have a huge impact. Somebody has to make the decision that there's a better song in there if there's less.
