Bullet performance does matter if you are shooting deer behind the shoulder (which is where you are supposed to shoot them with a bow... not a rifle... not if you don't want to track them some of the time).
I have not had to track any big game animal that I have shot in over 10 years.Almost all were shot behind the shoulder with a high velocity cartridge using either a nosler ballistic tip or a barnes tsx.