I totally know what you mean
I'm having that exact same problem you are having with my '01 sr5 4runner. I know exactly what you mean. What I do I just pull the key out and push the alarm button and just keep trying. After 3-4 times I usually get it started. Its very annoying tho. And I have...