I live in the rust belt, I don't have center caps. I like the look without them, as many others do too. I did paint my hubs though. Shouldn't have any effect being exposed.
That's a giant chuck of metal there, and no moving parts. As long as the face and bore (wheel mounting surfaces) don't get rust build-up, there is 0 worries of rust.