Adaptability research is a key field of scientific research globally. Its core aim is to improve adaptability. In this study, for constructing the measurement index system of farmers' adaptability to ecological and environment changes, we used principal component analysis to quantitatively evaluate the adaptability of farmers to ecological and environmental changes and analyzed the main driving factors in different regions and different livelihood types of Hangjin Banner, which is located in the hinterland of Kubuqi Desert. The results indicated that:(1) the farmers' adaptability to the ecological and environment changes is poor in Hangjin Banner. Particularly, the adaptability of farmers in the Liangwai area of the southern region is higher than that in the Riverside area of the northern region. The farmers' adaptability to the ecological and environmental changes of the facultative farmers is higher than that of the pure farmers and non-farmers. (2) The driving factors of farmers' adaptability to the ecological environment changes are the degree of labor and livelihood diversification, the status of arable land and material wealth, awareness about the environment, and the infrastructure conditions and status of animal husbandry. Finally, we provided suggestions for improving the adaptability for rural ecological environmental change of Hangjin Banner.