Climate change has had a significant and profound impact on Tibet. Farmers and herdsmen have a more systematic understanding of the local impacts of climate change. In this article, the Naidong District in Tibet, is selected as the study area. In order to explore the relationship between altitude and farmers' perception and adaptation behavior, and analyze the factors that affect farmers' and herdsmen's perception and adaptation to climate change, the farmers' and herdsmen's perception of and adaptation to climate change at four different altitudes in Naidong District were first surveyed, and then the meteorological data were used to compare the farmers' and herdsmen's perception of climate change. The results are as follows. The warming trend is obvious in the study area, and the annual precipitation has decreased significantly since 2005. The relative perception intensity of local climate change is different among farmers and herdsmen on different gradients. The relative perception intensity of farmers and herdsmen on the changes of temperature and snow cover was higher and increased with elevation, while the relative perception intensity of rainy season, crop diseases and insect pests, and new pests and diseases decreased with elevation increasing. Farmers and herdsmen generally had a low relative perception intensity of annual precipitation, but they had a deep memory of the persistent decrease of annual precipitation in recent years. Under the background of global climate change, the upper and lower ends of the basin suffer more negative impacts of climate change. Farmers and herdsmen's perception of local climate change is not synchronized with their adaptive behavior. Farmers and herdsmen's educational level, economic status, local traditional culture and their perception of climate change will affect their adaptation measures to climate change. In formulating and implementing climate policy, the government should take into account the differences of climate change characteristics and impacts at different altitudes in a basin.