I don't think anyone would assume once had now doesn't still legal.

What if he lost the whole horn and you knew he was a 5x1 before that.

You can't shoot the unicorn.