RE: Mixed feelings about going hunting with my brother
Do it.
You don't have to sit on top of each other. You can still be by yourself and enjoy that style of hunting. When you hear that shot coming from where he's hunting you'll be as excited as if you just shot one.
You may also be able to do things together you can't do alone, especially on days that are not condusive to stand hunting. For the short-term and minor inconvenience this may cause you, you'll definitely come out ahead in the long run.