Shifter shaft moves making the the shaft seal unable to seal properly

Basically this rod can wiggle in and out a bit so when I try and install the seal and punch it in with the 9/16th, it ends up just getting popped out when the shifter rod moves. Anyone else have a similar issue and know how to fix it? It drops oil out of the the shaft opening

Basically this rod can wiggle in and out a bit so when I try and install the seal and punch it in with the 9/16th, it ends up just getting popped out when the shifter rod moves. Anyone else have a similar issue and know how to fix it? It drops oil out of the the shaft opening