There's no such thing as a punch down switch........if you're running strictly patch panels and have no actual switch or hub (there's a huge difference) then you did it all wrong. No two ports should be directly connected to each other.
And wifi is only irritating if you don't set it up the right way. I have no problems with any of the WLANs at my house (yeah I have like 5).