I have a 2011 SR5 and I take off my running boards and rocker trim every time I go off road. I have phenomenal ground clearance with them off, but it looks unfinished. The metal isn't smooth and there are exposed plastic bits that are odd colors. I would not be happy if this were the permanent condition.
If you have tools and are somewhat careful there are threads with detailed pics showing how you can cut your rocker plastic to fit things like high-mount sliders or N-Fab steps. Otherwise you'll have to buy the delete kit.
Cutting:
ANTMAN'S Thread