Extra rivet pin retainer