The number one reason for reduced wildlife numbers is habitat destruction. That means housing and industrial development. With our current regulations, there has never been a single case of wildlife becoming endangered from hunting.
You can hunt on a 500 acre forest for the next 100 yrs and see no significant change in animal and bird populations. Build a housing development and shopping mall on the same piece of land and the wildlife will all be gone tomorrow.