Without getting too much into the debate, I'll just say this to the OP:
It only takes a few minutes to disconnect either one. Try just the front, just the rear, and both. Drive on each setup for a few days and hit a local trail so you get a feel for it. Then just pick whichever one you like.
On all my previous toyotas (all solid axles) the sway bar was the first thing to go. On my '97, I disconnected both expecting a softer ride and really got a lot of slop in the suspension and body roll. This is what I run (I don't have disconnects, just a wrench) and I like it this way:
street and regular trail rides: both connected
harder wheeling: both disconnected, tires aired down