This happens on my 04 as well. The sound gets worse when you add an aftermarket headunit with the adapter, and a seperate amp for the speakers... As far as I know there is no way around this, but it is normal.