So here's my experience....while none of my lenses is valued higher than perhaps £200-£300....I still prefer to put a skylight on the front in case of accidents. I do shoot on the beach, I have dropped cameras....I really don't want to have to pay to replace any of my lenses. I've accidentally dropped a camera lens-first onto a rock. The skylight filter was seriously damaged, the lens glass was protected 100%. I've not noticed any difference, and yes I have tried taking the filter off and taking the same photo as with the filter.
I'm sure there are some circumstances where a filter can cause a change in the image....especially if it's a cheap filter which isn't multi-coated. But I'd really like to protect my Flektogon 20/2.8, thank you....so I can continue to shoot into the sun with it.