I had to remove a couple more rivets to get the skin where it needed to be for the door to match. I tediously worked on the shims and ended up using the .062.....025....015 thick shims along the edge of the skin to get the door / fuselage to fit better.
I got the shims in and riveted the skin in place once again. The result came out good....not perfect but good!