without a cat youre going to get a lot of rasp unless you actively combat it with a bigger resonator and stock mufflers.

id keep it if i were you. it smells like you have no cat, so people can tell. it sounds worse without it. your bumper and tips will accumulate soot as well.