Wheather you realize it or not, you are doing strength conditioning while you are shooting your bow. You don't need to stop though. It is better to do your regular shooting one day, and the only do a few shots the next.
Then keep alternating like that. You will get stronger, but not fatigue yourself. You need to keep getting stronger, though. And the strength will help you hold more steady.

Good luck