Unless you have remarkable vision you will probably not be able to notice the slightest difference between a 40 mm obj lens and anything bigger.
The 40's are cheaper by a considerable amount and if you can't recognize a substantial difference-or any difference- I'd stick with the 40 mm lens.