I definitely agree about utilizing the rear window for airflow. However I couldn't agree more about the feeling of having your top and doors off, whether it be on road/offroad. I'm just lucky enough to have my wrangler as a toy nowadays.
It all depends on what your intended purpose is. If its because your bored, then don't. Unless you really want to take the doors and top off and enjoy the summer. I have owned a number of Jeep vehicles and luckily i have never had any issues with mine. I still currently own my 2012 JKUR that is...