Does it make focusing less precise or make the adjustments more pronounced and make it easy to pass your sharp focus point? If it's just a matter of passing your sharpness just slow it down, which isn't bad advice no matter what. Just slow things down. (Preaching to the choir, here) I should take my own advice more often. But if it actually damaged the lens, it might not hurt to have a shop look at it to give you an estimate. Might be worth it, might not.
Keep it light, Marko