Got a fog machine?? I'd send fog/smoke up the tailpipe and figure out what spot is leaking.
Would make it eaiser to tell if it's the rear manifold or the downpipe flange leaking.
Otherwise removing it isnt hard, just time consuming and you might break a couple exhaust crossover bolts, they tend to snap alot.