I fixed it
I guess I should have posted that I fixed this shortly after posting this. I popped off the back covers of the roof rack and just slid out the cross members (since I don't use them anyway) out the back and no more rattle. If I do need them, it only takes about 5-10 min to put them...