I was able to get this fixed. It turns out when I gunned it on without sliding it to fit the key, I had the HB spun 180 degress from what it should of. The key pushed against the metal on the inside of the HB and that created a bump that wouldn't let me slide the HB on properly. I was able to carefully file it down just a little bit and it slide on and now everything is good.

Thanks everyone for your help!