The belts themselves are rubber and over time begin to dry rot, much like your tires. So while it may look fine, the belt itself may be very brittle and could break. Part cost on it should be $30-$50.
As for the tensioner, I probably wouldn’t change it unless it’s making noise.
Sent from my iPhone using Tapatalk