Final Update with Solution:

So I took the door apart and was able to read voltage getting to the window motor, so it wasn't a problem with the switch. Heard a faint single click from the motor every time I pressed the down button. Replaced the entire motor and regulator assembly today and everything works fine. Thanks for the help guys, just kinda weird that both windows would go bad at the same time with the same symptoms of working great and then instantly stopping and working perfectly sporadically. Hope this helps someone if they have the same problem someday.