Resources conservation and mitigation of the pressure on the environment could be achieved by recycling of industrial solid waste. As a very important economic sector, construction industry is one of the main sources of energy consumption and carbon emissions in China. The production of building materials play an important part in energy consumption and carbon emissions in construction industry. In addition, building materials production is an alterative way of reusing the solid wastes from coal-driving electric-generating plants which can significantly reduce the energy consumption or carbon emssions of building material industry. Coal fly ash and coal gangue are common industrial solid wastes from coal mining or coal combustion processes. The quantity of coal fly ash and coal gangue is very large especially in coal-resources-based region, for example Huaibei City in China. Novel wall materials can be produced from recycling coal fly ash and coal gangue which is an effective way of energy saving, resources conservation and mitigation of environmental hazards. In this study, we take the novel wall materials (fly ash block, coal gangue brick) made from industrial solid wastes and conventional wall materials (clay brick, perforated clay bricks) made from clay in Huaibei City as examples to analyze the eco-efficiency and carbon emissions of them. Then we established a linear programming model to regulate the production of four kinds of wall materials in order to achieve the highest eco-efficiency and reduce canbon emissions for wall material industry in Huaibei. The results show that the eco-efficiency of novel wall materials are higher than that of conventional ones. The carbon emissions of coal gangue brick is higher than that of conventional wall materials while the carbon emissions of fly ash block is between the clay brick and the perforated clay brick. In order to achieve the highest eco-efficiency and carbon reduction of wall material industry in Huaibei, the use of clay brick for building materials production should be forbidden and the production of perforated clay brick should be decreased while the production of coal gangue brick and the fly ash block should be increased. As a result, the ratio of recycling coal gangue solid wastes increased from 15.8% to 25.2%. These results can be useful in the identification of available techniques for building materials made from recycling industrial solid wastes.