Seems it really was just the adjustor screws being loose. Now it sits nice and flush. Now I am hoping it doesn't pop back up.