Livestock grazing within protected areas may negatively affect wildlife; therefore, it is important to determine divergent behavioral responses of various species towards grazing disturbance. Infrared cameras were used to monitor grazing status in Hetaoping area, Wolong National Nature Reserve, Sichuan, where the government implemented an incentive policy to encourage livestock production (including yaks and goats). We used the images to study the spatial distribution and activity patterns of the giant panda (Ailuropoda melanoleuca), red panda (Ailurus fulgens), golden monkey (Rhinopithecus roxellana), and sambar (Rusa unicolor), and evaluated divergent behavioral responses of these four species to livestock grazing. The results showed the following:(1) in the first phase (2012-2013), the local government banned all horse grazing beginning in October 2012. The incentive policy was implemented in December 2012; it allowed 10 households in each village to get a loan without interest to support yak and goat rearing. There were few images of livestock, but many images of the four species. In the second phase (2014-2015), the number of images of livestock (P < 0.01) increased significantly, while images of the red panda (P < 0.05) and golden monkey (P < 0.01) decreased significantly. Images of the giant panda and sambar also decreased. In the third phase (2016-2017), the number of images of the giant panda, red panda, and sambar increased. Late in the third phase, i.e., January 2017, the number of images of the giant panda, red panda, and sambar basically rebounded to the levels observed before the policy was implemented. However, there were no images of golden monkeys. (2) The four species had wide distribution in this study area in the first phase. In the second phase, the spatial distribution of the giant panda and red panda shrank after the implementation of the livestock policy, and the spatial distribution of livestock and sambar increased. Spatial distribution information for the golden monkey was not available. In the third phase, the spatial distribution of the giant panda and red panda returned to the levels observed before the incentive policy was implemented. Additionally, there was no spatial distribution information for the golden monkey. (3) There were no differences in the daily activity patterns of the giant panda, red panda, and golden monkey before and after the implementation of the livestock policy, but images of the sambar were obtained more often at dusk after the implementation of the livestock policy. These results indicated that different wildlife taxa show divergent behavioral responses towards grazing disturbance. Consequently, to formulate more scientific and effective management and conservation policies, more comprehensive evaluation of the effects of human disturbance (e.g., livestock grazing) on multiple species are required in the future.