Well I know just what you mean... When I first started collecting rifles they had to have a wooden stock or were not considered. I once said to friends, I would not own one of them plastic stock rifles... How wrong I was. I own several now.
When I got my first one, it was a CVA Staghorn Magnum I believe, I was not impressed with it at all. The composite stock did not fit the hardware of the rifle well. But for $89.00 what does a person expect. After I shot the rifle for a while I have to admit they were starting to grow on me. After that, more and more of the rifles entering the collection had composite or laminated stocks. The rifle I was shooting today had a composite stock.
I guess I just learned to accept them. Like you, I do not baby my rifles. They get banged around, dropped, I even fall off small cliffs with them and land on them (that was a trip...) but the more I hunt with the composite and laminate the more I like them. I guess an old dog can learn new tricks.