I'm wondering if the boost bypass valve on your supercharger is heavily gunked up and sticking open temporarily. I recently pulled one off of my parts car that was so gunked up I could hardly turn it by hand, I could only imagine the impact it would've had on the responsiveness of the valve when it was being operated by the vacuum system.