I took the one off my 99 Limited with a flat blade screwdriver. Just placed it between the plastic part of the seat and the bar and pried out. Are you talking manual or electric?
It will either pry off or have a c-clip that can be removed before pulling off.
The old-school trick for the c-clips (used on old window cranks) is to slip a towel in there and pull on it (parallel to the panel) to release the clip.
In case anyone ever needs to know - the dial to adjust the seat height on an SR5 is held on with a C-clip. I removed the 4 bolts that hold the seat down, flipped it over, and was then able to reach the clip using the hook tool seen in the photo.
For several years the dial/clip have been rattling and driving me crazy. So I finally got in there and did something about it.
Thanks TRD 4RNR, this is exactly what I was looking for. The factory manual simply says remove. I did not want to start prying on it and break something! took a few years but your post helped someone else.