Alright, there are 2 things to look at. First is the throttle return damper (or what ever it's called). Basically when you let off the gas completely it prevents the throttle butterfly from slamming closed. IIRC it works when the throttle is opened (loses vacuum) so the plunger extends, when you let off the throttle completely it absorbs some of the initial shock. When the throttle closes it creates vacuum and the plunger retracts to its idle position. Then the idle control valve takes over.
The plunger could be bad or have a vacuum leak in the hose for the plunger.
The second one is your idle control valve. It could be gummed up and need cleaning. It controls idle rpm's when it's idling, and will open up more letting more air bypass the throttle plate causing the bump up in rpm when the ac is on.
If you cleaned your throttle body on the engine then all that gunk and junk washed down into the idle valve. It could also just be old age too. Nothing lasts forever.
The pic is of the plunger thingy.
Here is a vid of cleaning and testing the idle control valve:
https://www.youtube.com/watch?si=wkPLHutU6Hrr9cj8&v=agIRNNA-6cs&feature=youtu.be