I just hit the back of the wheel part of the hub with a hammer, and it pushes it right out with a few whacks...