Remember practice doesn't make perfect, perfect practice makes perfect. Don't get frustrated that won't help your groups plus it is the path to the dark side(TARGET PANIC) and you don't want to have to deal with that. Check your bow to make sure its properly tuned, but it doesn't sound like your groups are that bad so my guess is its human error, go through your form piece by piece like a check list, it could be anything from minor inconsistancy in grip, release, anchor etc. I to shoot a WB rest and have no problem touching arrows when I practice as long as its tuned. Good luck. it will come together soon enough.