I think I would agree with Lemoyne and leave the washer in and epoxy around it so you get the correct height. Of course, if you apply too much epoxy, you can always file it down until you get an exact fit.