If you take them off - and you have a noticeable difference in the paint...you could always put them back on.

And DO either use fishing line or dental floss - by trying to pry them off with your hands - you can either dent your door/trunk or damage the badge itself. Plus - this is the most effective way to remove as much of the adhesive as possible...the first time.

-Swash