During this I felt that the co-pilot side did not pull forward far enough and it dawned on me that maybe the aluminum spacers where hitting. So I took everything apart, removed both spacers, sanded them down a little and put the whole thing back together.
Sure enough the co-pilot side pulled in tighter, so I re-drilled the hole and the new hole came in about 1/32 different.