I would want some cover around me. A telephone pole offers no cover whatsoever so I'd want to be much higher, maybe 25 feet or so.

You can get away with 10 feet if background cover is there to break up your outline. On a telephone pole I think you'd stick out like a sore thumb. But if the deer aren't spooky you might get away with it.