OK. So I pressed and wiggled the button a few times, and it turned off. Wiggled a little more and it turned back on. Now it works every time. I am thinking that there must have been some junk in the button that I managed to wiggle loose.