That is exactly what you should do. When you get frustrated just walk away and come back later to see if things get better. Fight the urge to end on a good shot, or keep going until you figure it out. And REALLY resist the urge to start tweaking on your bow. If it shot great yesterday chances are nothing changed except your form or concentration.
Shooting frustrated is a great way to get target panic, but I don't think that is your goal

.
Paul