If your after high quality picture, then by all means do not get an IR camera. Your regular flash (white flash) will give you normal looking pictures. But even in saying that, it will all depend on the camera you choose to get.

Normally a cheaper camera will not give you quality pictures in the first place, IR or white flash. You also should remember that your night pictures will be limited in distance, depending on the flash with your camera. If you get 45 feet, you are doing good.

But, in your statement above:
it sounds to me that getting a camera which is less intrusive in your area is really what you want. If that is the case, then you will want an IR camera. That is their best advantage, NO White Flash to spook animals or let other people where the camera is located.

I was in the same position as you are in a few years ago, I could not find a trail camera that was up to what I wanted that did not cost way too much money, I ended up building my own and got what I wanted for a reasonable cost.

Good luck.