Vegetation restoration is a crucial component for abandoned mines in Giant Panda National Park to fulfill the ecological functions of a "national park". However, more research is needed on the composition of plants and the factors that influence vegetation restoration in abandoned stone mines. Therefore, a typical stone abandoned mine in the Ya'an area of Giant Panda National Park was selected as the object to investigate the plant community and environmental factors under natural vegetation restoration, analyze the plant composition and differences between abandoned mines, and then the main influencing factors of natural revegetation according to environmental factors. The findings of this study reveal that perennial herbaceous and shrubs are the primary plant types for the natural restoration of abandoned stone mines. A comprehensive survey was conducted of 121 plant species, spanning 66 families and 105 genera. Notably, Rosaceae, Asteraceae, Poaceae, and Salicaceae emerged as the main native pioneer plants, widely distributed in most abandoned stone mines. These results underscore the challenges of natural restoration in such environments, with particle size and recovery time identified as the key influencing factors. In light of the pressing need to enhance the ecological function of the Giant Panda National Park, it is imperative to establish a restoration reference ecosystem. This ecosystem should guide soil reconstruction and vegetation community reconstruction based on the park's unique ecological functions. Furthermore, a technical system for systematic restoration must be constructed. This system will play a crucial role in promoting the ecological restoration of the park.