The Loess Plateau is a highly coupled area of ecological fragility and deep poverty in China. Faced with the dual pressure of protecting the ecological environment and ensuring the livelihood of the poor for a long time, the contradiction between human and land is prominent on the Loess Plateau. How to coordinate the balance between rural ecosystem system and farmers' livelihood system has become the key to the stability and sustainable development of regional human-land system. Based on the concept of stability, this paper took Jia County on the Loess Plateau as an example to quantitatively evaluate the stage of ecosystem system and livelihood system by using geospatial data and questionnaire survey data. The interaction between the two systems was sorted out and the conflict and coupling types were divided by coupling coordination degree model and relative development degree model. On this basis, the causes of the conflict relationship were analyzed and the classification management suggestions were put forward, in order to provide reference for the alleviation of regional human-land contradictions and sustainable governance. The main conclusions are as follows: (1) The overall stability of ecosystem in Jia County was in high grade, but there was obviously geographic variation. The ecological stability pattern in the county showed the characteristics of "patches of low values in the north and scattered low values in the south". The human factors represented by road traffic land and construction land had significant influence on ecological stability; (2) The overall stability of livelihood system was in medium grade. Farmers' livelihood modes had tended to be diversified, but their livelihood capitals were generally lacking. Diversified livelihoods could partially compensate for a dearth of livelihood capitals, but rural geographic location and natural conditions could not be ignored in maintaining the livelihood stability; (3) The relationship between ecological system and livelihood system was mainly conflict, including moderate conflict, mild conflict, near conflict, and reluctant balance. The reluctant balanced area belonged to the false balance with low stability of both livelihood system and ecological system. Most villages in the conflict areas with sharp contradiction between human and land were lagging in livelihood, and the primary cause of human-land conflicts was the deprivation of livelihood space by ecological governance. It is suggested that by combining measures of the top to down management of decision makers and the bottom to top promotion of actors, the contradiction between human and land in counties can be gradually resolved, and the internal coordination and stability of the ecology-livelihood system can be realized.