It could be a number of things: TPS, Vaccum Leak, EGR Stuck Open, Idle screw came loose on the TB. I could be one or a combination of these things things.
I assume its a 3VZE, so what are the RPMs running at when Cold & then at Normal Operating Temps ? Be more specific about the rough idle if...