The obstructions in the manifold are in the primaries where they join...not the inlet that touches the cylinder head.

You can't really port that without cutting up the manifold and rewelding everything.

Would it hurt?

No.

Is it worth it?

Probably not.

I had a wrapped x-over...and I ported my front/rear manifolds at the same time I did a 3" DP.

I noticed a difference but it was probably all in the downpipe.