Should not take that long. Mine usually shifts in 3-7 seconds. Occasionally I've had it not switch, and the indicator light on the dash keeps blinking. When it does, I'll stop, go in reverse, then stop, shift into Neutral, then flip the switch knob again.
Pages 167 - 175 for 4WD operation
4Runner Owners Manual - 2008
https://assets.sia.toyota.com/public...f/OM35897U.pdf
If the 4LO" (low speed four−wheel drive) indicator light continues to blink and the buzzer sounds when you operate the four−wheel drive control switch knob to the H4" or L4" position, drive forward or backward in a short distance, then stop the vehicle completely, shift the automatic transmission selector lever securely into N" and operate the switch knob again.
If the indicator continues to blink even if doing so, contact your Toyota dealer as soon as possible. There may be a trouble in the four−wheel drive system