There are always some metal shavings on the magnetic drain plug, and gear oil is pretty thick compared to engine oil.
I would just change it with new gear oil, and go from there. And clean off the magnet on the drain plug before you re-install it.
It may have been changed before, if you aren't the original owner.
My best advice is, don't worry about things until you know there is a problem.