After some searching, I think I found what might be the same problem I have... My whining noise is only on deceleration and it sounds to me like bearings. Anyway, I found this in a thread...
Fellows,
1997 sr5, 5speed 4wd. 170k miles. Ugly roar on deceleration. Here's the end of the story...