dont change the pulley unless you have a downpipe and all of the cheap mods (intake, t-stat, plugs).

even then i wouldnt change it. i have a lot more done than you and im knocking up to 5* with a 3.4. a 3.5 puelly would put you pretty far up the boost ladder. open it up more before you say you want to swap pullies.