I know this is an older post, but when I took the badges off of my Volvo, I had the same issue. I removed the pieces with dental floss (I'm not kidding, it worked really well).
To get rid of the leftover marks, I used McGuiar's Scratch-X wax. It comes in a small tube and is meant to be used to cover/remove scratches. I THINK it's color matched, but I'm not sure. The Volvo's black, so the marks were very easy to see. The Scratch-X took it out after 3 applications, and it's like they were never there.