It is very critical for Panax ginseng to choose suitable sites in a forest environment. Leaf litters play a very significant role in determining soil physicochemical properties and shaping soil microbial communities in forest ecosystems, but their effects on the soil of understory wild ginseng and cultivated ginseng are unknown. In order to study that, leaf litters from five tree species[(A) Acer mono Maxim. var. mono, (B) Pinus densiflora Sieb. et Zucc., (C) Juglans mandshurica Maxim., (D) Tilia amurensis Rupr., and (E) Quercus mongolica Fisch. ex Ledeb] were added to Panax ginseng-growing soil. MiSeq high-throughput sequencing was used to analyze and compare the bacterial and fungal diversity and community composition of soil samples from different tree litter treatments, and 6064 and 1900 OTUs were obtained from eighteen samples based on high-throughput sequencing of the V4 regions of the 16S and ITS1 rDNA gene respectively. Bacterial species detected in these samples covered 42 phyla, 117 classes, 170 orders, 213 families, and 225 genera, and fungal species detected in these samples covered 24 phyla, 98 classes, 196 orders, 330 families, and 435 genera. Our results indicated that the physicochemical properties of soil were significantly affected by all leaf litter treatments. Soil total nitrogen, available NPK, and soil microbial biomass (carbon and nitrogen) were significantly (P < 0.05) affected across all treatments. In addition, we found that the soil bulk density and C/N ratio were lower following all treatments than in the control (no addition of leaf litter). Significant changes in the bacterial and fungal community composition could be identified in all soils; specifically, the relative abundance of Proteobacteria was higher in treatments than in the control. In addition, the bacterial communities of Bacteroidetes and the fungal communities of Basidiomycota were smaller in treatments with coniferous leaf litter than those with broad leaf litter (P < 0.05), and the fungal communities of Ascomycota might be the key microbes for decomposition of coniferous leaf litter. LEfSe[Line Discriminant Analysis (LDA) Effect Size] revealed that the overexpressed bacterial and fungal genes were obtained from the kingdom, phylum, class, order, family, genus, and species levels, in that order, based on relative abundance. These include the bacterial communities of Sphingomonas at the genus level in treatments of D, the fungal communities of Exophiala equina and Podospora glutinans at the species level in treatments of B. Canonical discriminant analysis (CDA) ascertained that the shift in the microbial community (the bacteria of Bacteroidetes, Chloroflexi, and Actinobacteria and the fungi of Basidiomycota, Zygomycota, Chytridiomycota, and Ascomycota) composition and diversity were closely related to the changes in soil microbial biomass nitrogen, total nitrogen, available phosphorus, soil organic carbon, available potassium, C/N, and pH in all treatment soils. The results of our experiment suggest that addition of leaf litter has a significant effect on soil bacterial community development, and it can lead to higher soil nutrients and soil microbial biomass as well as a different bacterial community composition. The resultant soil bacterial communities affect leaf litter decomposition and wild understory ginseng management.