Remove the tail gate strap first. Then I just take a flat head screwdriver and starting at the bottom, I pry the panel off. It's held in place by plastic rivets that snap into place, so just take your time.
it always makes me nervous cause it feels like your going to break it, but Rock Slide is correct they are snapped on and you gotta pull or pry pretty hard to get them off. Good luck.