Having felt very similar to you and then making the upgrade to the GX 460, I think you should give it a shot. If building is your thing, there are a few very cool GX builds, growing aftermarket support and it's way, way less common than the 4Runner.
V8/6AT is just no comparison to the V6/5AT in terms of drivability. Like we all know, 270hp/278lb-ft of torque is plenty on paper, but hooked to that 5AT with tall gears and no urgency to downshift makes the 4Runner absolutely awful to drive. The GX is no speed demon but it moves and you don't have the lethargic feeling of always nailing the skinny pedal to the floor just to get through traffic or merge.
GX takes all the great things about the 4Runner and dials them up a few notches: comfort, drivability, power, quality, quietness, etc.
Only thing will be cargo room. If you really need much more of that, a GX is not going to help you much. But for everything else, I'd rather have a GX over an LR3, LR4, or LC100.
Oh - the best part? My GX is +2MPG over my 4Runner with two more cylinders, 30 more hp and 47 more lb-ft. The torque of the V8 mean you don't have to wring it out just to get through an intersection, and lower RPMs everywhere mean you're burning less gas (especially on the highway).