Get yourself a mechanic's stethoscope and pinpoint where the sound is coming from, just be very careful not to stick it into any moving parts, you can get them at any auto parts store for around $7 to $20 and very good ones can go upwards to more then $100, but the basic less expensive ones work well enough and you'll be amazed at how it sounds up close and personal when you actually pinpoint where the sound is coming from, and if it is your alternator you'll know once you stick the probe on it.
Just don't confuse normal engine and components sounds from abnormal ones, you will be amazed at all the different sounds that make up the normal sound of your engine running when you isolate each of the sounds with the stethoscope.