Two things:
1- Those coin batteries might read 3 or 3.3 Volts on a multimeter and still be bad if they're old. When in doubt get a new battery. Drove me crazy till I figured it out. The little red light is a good indicator. Also, like someone mentioned, a battery tester is a good tool to have...