Keep at it - I know it get's frustrating when you aren't seeing any mature deer - but it sounds like there is some sign... Log as many hours as you can...

Do you know much about the immediate area? Has it been over hunted?