About the 54's recoil system. It has a few fiber? rings there where the stock fixings sit in the recoil system.
Could those cause larger grouping or flyers because those rings are flexable upto a point?
So is it worth it to exchange these to metal washers?
Just a thought..
Unless they are real loose or differentially loose, they should not affect the POI.
Changing to steel would probably over stress the wood, JMHO.
Make sure you have them both tightened the same and that one has one washer on top and on bottom while the other has only one washer and rests on the steel "liner" inside the stock.