Not sure why you need to loosen the panhard bar. I've done spacers in the rear of my 4runner as well as 2" springs on a 5th gen and the Panhard bar did not need to be loosened or removed.
You will need to disconnect the sway bar though. I found disconnecting at the endlink is the easiest.