You can drive it, but I'd be willing to bet it's running rich on the fuel side. If it is overfueling it can lead to damaging the catalytic converters. Fix the exhaust leak.

Beyond that, if you go with a replacement upstream oxygen sensor, stick with the Denso brand. These cars seem to not like Bosch O2 sensors.