Most dipsticks have a curve/twist at the bottom and should pull the piece out with it. I see it all the time at my work.

That you stick it back through the broken piece and spin it out while pulling the dipstick out.