IMO, it could be a bad master switch, mine acted the same way, went to the Junk yard and scored a working used one, no problems since.
I certainly hope that fixes the problem. In order to get the master switch out of the door panel do you just pop it out or are there screws that hold it in? I hope I can find a video on you tube that shows how its done. It can't be that complicated though.