It could be a heater core or Air Conditioner evaporator clogged up with leaves or other debris, and/or one of the blend door / airflow doors is just swinging loose as you drive.
Do all of the airflow positions work when you move the lever (i.e. vent only, split vent/feet, feet only, spit...