There are 2 ports on the solenoid the upper one is exhaust and the lower is for opening the valve when called for. If you are connected to the top port it won't allow air to escape the lower portion of the bypass and it won't close all the way because the air trapped inside the actuator. Have you already replaced the solenoid and everything is good now?

Jeff