Here's the answer you've been looking for.

I drove mine with the belt off for about a week while I was waiting on parts (pulley puller broke after the pulley came off..... (that sucked)

...drove about 500 miles that way and didn't see any change in gas mileage.