Next day I hunted from my tent blind and every deer stopped and stared at the blind from @50yds away
And that is exactly why it is recommended to set up ground blinds weeks in advance, OR why it is necassary to blend the blind into the natural surroundings. Turkeys will except a blind that was not there yesterday, but is there today, even if it is in the middle of a plowed field. Deer on the other hand, don't easily except the "thing/blind" that is out of place, odor or no odor!!
If you can get into and out of a tree stand with no deer detecting you, then hunting the same stand a few days in a row can be done!! The hard part of that is finding that place that is in a good kill spot/location but yet can be entered/exited without being detected!!