Mine burned out as well. I was hoping it used the same size bulb as the HVAC controls, but after closer inspection the plastic base is shorter than the long ones needed for the HVAC replacement.
Removing the window switch is pretty easy. Just remove the HVAC/display console and you can get to the tailgate window switch on the left. According to Partznet the hazard switch also has a bulb, so I'm hoping it's the same one that lights up the tailgate window switch. I had no idea that the hazard switch also lit up, so I guess I need two bulbs now. If only I can figure out the damn part number!