yes, no problem, you can remove it.
I also needed more room for switches. I was able to find a limited shift bezel / console that had the 5 switch positions. Added my seat heater switches to the outside, moved DAC to the center, and light switches in the other spots.