You can try with just the side loader but I found I was not getting the boat out far enough away from the truck and got a few scratches. The aero bars let you get the side loader further out and therefore the boat further away from your 4rnr. I had the hullavator and loved it but my current...
I had similar problems. In the end I mounted my Thule aero bars onto my gobi and then used the rhino rack side loader. Works perfectly for my hobie outback kayak. Before I had the gobi I did the same with the stock rack and it was great.