That's the only place there's oil. There's none anywhere else that doesn't look like spray. I feel like it's because the oil gets pressurized and it shoots out of the cap somehow.
Last oil change I did I got a new cap and used new rubber seals that come with the filter.