Decided to remove the rivet because it would bug me every time I saw it if I didn't. Masked the area around the rivet to help minimize damgage to the surrounding skin from tool slippage and stuff. Used a combo of drill, dremel and punch to finally get it out. Replaced it with a new one and called it good. Still requires minor trimming of the ends then I can match drilll it to the elevator.