There are plastic tabs holding the switch assembly to the plastic piece. Just pull them away from the switch

Look on the underside of the piece the button slides out through the bottom