sounds like a the 4 th gear hub is worn out. the replacement hardened 4 th is like 40 bucks now.
put the car in 3 rd gear on the highway see if it still slips, if not thats the 4 th hub wearing out.
edit: the perf shift button could be a rubbed through wire by the pcm. you should be able to feel a small difference on vs off.