I'm feeling like its the cam even though the lifter came up to the same height as the others.
When I had it apart, I could see the can lobe through the bottom of the lifter valley. So I ran my finger nail across it horizontally. I felt small ridges towards the edge of the cam lobe. So I did the same on the opposite side of the lifter valley and it kinda felt the same.