Update: When it doesn't work with the key fob, it also does not work from the switch in the driver's door. However, randomly yesterday it started working with both the key fob and the driver's door switch, then a while later it no longer worked with either. When it works, you can hear the actuator when you're standing next to that door. When it doesn't work, you don't hear it. So. . . it's intermittent!

I'll probably open up the door and check the wiring, and spray some silicone lube on the actuator in case it's sticky.