'They really have to be controlled' - Deer culling to go ahead