You can tuck them up into the fuel supply harness and tape it shut if you want. Just don't cut the plug off, never know when you want to put it back on.
Really, the only positive to taking it off is getting it out of the way. I didn't even notice a difference in mpg's when I took mine off years ago.