If you are using a line level converter then the speakers are acting like microphones to your subwoofer. You are converting the energy created by speakers to line level and feeding it to the amp along with the signals from the radio.
I figured I would add this as some people use the line level...