Shanyang County is one of the key counties of national poverty alleviation in Qingling-Dabashan contiguous poor areas. Shanyang County was used as a study area, and the ecological vulnerability index based on remote sensing and geographic information methods was assessed. In addition, a village-level poor economic evaluation index system was constructed, and the level of economic poverty of 239 villages in the study area was evaluated. Based on this, the coupling coordination degree of ecological vulnerability and economic poverty were evaluated, and the spatial variability of the coupling coordination degree was analyzed in the study area. The results showed that the overall vulnerability of Shanyang County was above the intermediate level, and the areas with high ecological vulnerability were mainly distributed in the valley width and strath terrace with frequent human activities and serious soil erosion. The overall poverty level in Shanyang County was high, and the terrain conditions, abundance of resources, traffic accessibility, and economic locations all contributed combined effects in the spatial distribution pattern of economic poverty in Shanyang County. The coupling coordination degree of ecological vulnerability and economic poverty were divided into six types. They included economic environmental common damage, economic environmental damage, economic damage, synchronous development, environmental lag, and economic lag type. The percentage of the synchronous development type was only 13%, and the overall coupling coordination degree of ecological vulnerability and economic poverty was low. The economic environmental common damage type, synchronous development type, and environmental lag type had a scattered distribution. The economic damage type, economic environmental damage type, and economic lag type were significantly concentrated, and the economic damage type and the economic lag type had distributions centered in the valley width and strath terrace, whereas the economic environmental damage type was distributed in the remote mountainous area. Based on the construction of the evaluation index system of ecological vulnerability and poverty, and applying the coupling theory to analyze the coupling coordination degree of spatial distribution at the county-village level, the goals of this study were to explore the cause for the mechanism of ecological vulnerability and poverty, and to improve the ecological environment in the Qingling-Dabashan contiguous poor areas. It is of great significance to target the regional poverty alleviation policy and realize sustainable development.