yes and no.
the o2 sensor does its job to up fueling when it notices that the AFR is high.
however, the colder air in this case is increasing timing VIA the IAT sensor which is increasing the possible MPG the car is able to achieve. however, most will see a decrease in mileage in winter for a few different reasons (winter blend gas, longer warm up cycles, more idling time, etc).