Farmers play an important role in the restoration of karst rocky desertification, but the knowledge about their attitude is little known. In this study, 154 families from 33 villages in Huanjiang, Du'an, and Dahua County, from places of different degrees of rocky desertification, were interviewed based on Participatory Rural Investigation. The results showed that the percentage of farmers who knew about karst rocky desertification was low, and decreases with increasing degrees of rocky desertification. The main factors influencing farmer's attitude of participation were education degree and age, but their participation sense was better in the ecological model zone than in the other areas. Ecological agriculture can be accepted by most farmers. However, it is difficult to perform because of limited costs, sales, and techniques. The economic development models supported by the government always have a positive effect on both ecology and economics, but are hard to perform. The models developed by the farmers are always easy to operate and have advantages of high income, but their scale is always small and affected by the market. Therefore, much needs to be done in the restoration of karst rocky desertification. On the one hand, propaganda and education should be strengthened, especially in areas of heavy rocky desertification. Ecological model zone should play its role and extend its influencing area. On the other hand, besides the support of existing economic development models, the government should strengthen the support of models developed by farmers themselves, such as silkworm raising and manual processing, to exploit the market. Altogether, the Government-Institutes-Farmer model, in which the government strengthens their support, scientific research departments provide technology, and farmers actively cooperate, should be formed to better restore the karst rocky desertification.