May sound like a silly question but did you use a clean towel with the goof off? I remember removing wax from my old car with what Looked like a clean cotton rag, scratched my trunk up pretty bad.
Hopefully is anything gets scratched when i do it it is under where the badge is as i am replacing it with a new one.