I had the same issue. While changing the transfer case oil, I noticed oil slowly dripping out of rear diff. It was bad, big thick flakes of the diff were falling off. The leak itself was probably around the seams and/or pinholes.
I think there are aftermarket parts (Toyota Pick Up Heavy...