Clarifying the influence of socio-ecological factors on the spatial and temporal patterns of ecosystem services in tourism destinations is of great practical significance for achieving high-quality development of regional tourism and ecological environmental protection. This paper analyzed the spatial and temporal evolution of five types of ecosystem services in Huangshan City from 2000 to 2020, including water production, soil conservation, carbon sequestration, habitat quality, and tourism culture. In addition, we also analyzed the intensity of the role of socio-ecological factors, aiming to reveal the link between the spatial and temporal differentiation of ecosystem services and the economic development of tourism destinations. The results showed that: (1) In terms of temporal distribution, the mean value of water production in Huangshan City increased and then decreased, and the soil conservation service showed an increasing trend, while the remaining three ecosystem services of water production, carbon sequestration and tourism culture showed a decreasing trend from 2000 to 2020. (2) In terms of spatial distribution, the high value areas of water production and soil conservation services were distributed in the Mount Huangshan Mountains and low mountains and hills in the south, and the low value areas were widely distributed in the middle and north; Carbon sequestration, habitat quality and tourism and leisure services, except for Mount Huangshan Scenic Spot, Qianxian County and Xin'anjiang River Valley Basin, were low in value, and other high value areas gathered significantly. The spatial distribution of cold and hot spots in the five types of ecosystem services was significantly different, but there was overall overlap. (3) As for the influence factors, the geographic factor had the strongest explanatory power, followed by the economic factor and the tourism factor. However, the influence of the economic factor and tourism factor was increasing, and although the geographic factor was dominant, the explanatory role was diminishing. The interaction between the two factors was mainly in the form of non-linear enhancement or two-factor enhancement, i.e., the effect of "1+1 ＞ 2". (4) The tourism-oriented cities influenced regional ecosystem services by strengthening tourism development orientation, guiding industrial clustering, and adjusting land use types; meanwhile, the optimization of the ecological environment in the region positively affected the tourism development environment. Therefore, we proposed a development framework of "tourism economic system-land system-ecosystem" virtuous cycle in order to provide theoretical support for the positive interaction between tourism-oriented urban ecosystem services and tourism economic development.