I took Marks suggestion and put the rudder axles in the drill press (using electrical tape to protect them in the chuck. I used a file, fine grit, 400, then 600 grit to take a bit of material off of the outer thirds of the axles. I also used some of the fine sandpaper to remove some remaining paint inside the support tubes on the fuselage. That paint is tough stuff which is good as long as you're not trying to remove it. All of the axles will now slide in and out without undo force so they won't be too difficult to remove if needed for maintenance or repair.
