Ectomycorrhiza (ECM) fungi can promote the water and nutrients absorption in the soil and improve the stress resistance of host plants, and play an important role in the material cycle of forest ecosystems. In order to explore the ECM fungal diversity and community composition and the possible influence mechanisms of soil physicochemical factors on the ECM fungi in cold temperate regions, the Illumina Miseq high-throughput sequencing platform was used to analyze the ECM fungal community composition of four typical forest types in the Greater Xing'an Mountains, including Betula platyphylla, Pinus sylvestris var. mongolica, Larix gmelinii, and Pinus pumila. The results showed that a total of 167 ECM fungal operational taxonomic units (OTUs) were obtained from the rhizosphere soil of the four typical forest types, belonging to 2 phyla, 4 classes, 10 orders, 24 families, and 36 genera. At the phylum level, the relative abundance of Basidiomycota fungi accounted for 96.4%, and Ascomycota fungi accounted for 3.6%. At the genus level, Russula (30.2%), Cortinarius (17.1%), Piloderma (9.6%), Tomentella (7.2%), Inocybe (7.2%), and Sebacina (6.2%) were all over 5.0% in relative abundance, which were the dominant ECM fungal taxa in this area. There were significant differences in the composition of dominant ECM fungi at the genus level in different forest types. Soil physicochemical factors explained 92.4% of the ECM fungal community variation, among which nitrate nitrogen, soil total nitrogen, and soil pH had significant effects on the ECM fungal community composition, with explanatory degrees of 60.4%, 10.6% and 9.5%, respectively. The results provide a basis for understanding the community composition and functions of ECM fungi in cold temperate forest ecosystems.