Looks like you're on the right track. Took me a total of a few hours to get it off and put it back on. I painted it in bet/w.
I believe you do have to remove the two screws under the panel...Just try to figure out which screws/nuts are in the same place as the chrome trim panel. It's been awhile but it wasn't too difficult. Little trial and error...
I wish I could be of more help.