I've never worn out a steel bolt stop pin...or hammered out the receiver where it goes into (since the Al is the softer metal it'll get loose first). But I've only put about 15,000-20,000 rounds through a single 10-22 too. Have had several but that's the longest I've ever used one rifle and it was used when I bought it.
A friend of mine put a Volquartson action kit in one of his 10-22s that also included a buffer rod to replace the pin. The first thing you'll notice is that there is one less metallic clunk when the action cycles, so yes the bolt does contact the pin when you use standard HV ammo. It does help quiet down the action and eliminates one less wear point and shock per cycle.
This is in his daily carry farm rifle, so it gets daily occasional use besides our fun sessions. It was kitted at least 8 years ago. Still has the original buffer rod and it didn't look that bad the last time I seen he had it apart for cleaning.
There's a lot of contact area on a 10-22 so it's not like there's one or two sharp edges that'll chop up a buffer.
I'm guessing that you'll have that action out of the stock for cleaning many times before you'll need to replace that buffer.
Can't say that I've ever had a problem with zero-shift when removing the action for cleaning on a 10-22 either but I've always used a full-floated barrel so the only contact point with the stock is the action (and it's only held in by one screw so the action had better fit the stock pretty well to ensure consistent accuracy).
If the action fits the stock properly and the barrel is free-floated it'll drop back into the same place