SOLUTION
Pull the window switch out of the door panel (or take the door panel off if necessary). Disconnect the plug from the window switch. If it has five wires, then cut up a paperclip and stick in a jumper between pins 1-2 and 4-5. You can confirm the pins to jumper by using a multimeter in continuity mode on the power window switch when the switch is in the neutral position.
Tape up the plug with electrical tape and shove it somewhere where it won't rattle. Turn on vehicle and test all driver's window switches.
What this will do is allow the driver to control all windows but disallow all control from that door permanently. You can easily undo this by pulling out the metal jumpers and reconnecting the window switch.
What if you want to be able to toggle this business back and forth at will? Then you need to install a 20A relay on each respective power window power feed at the fuse box and wire them all up to a toggle switch. While this cuts power to each window regulator, Toyota's clever (or lazy) implementation instead feeds power from the "Power Window Regulator Master Switch Assembly" through the power window switch in each door when the driver uses a window switch for any window. That's why disconnecting the window switch disables the window entirely.
This is how it was wired on my Corolla/Matrix/Vibe and I wanted to share it here because this thread was the first search hit, and knowing Toyota engineering, I doubt they've changed it in 10 years.