Arbuscular mycorrhizal (AM) fungi are ubiquitous soil fungi that can form symbiotic associations with the majority of terrestrial plant. AM fungi play key roles in plant resistance to various environmental stresses, such as nutrient deficiency, drought, and soil contaminations. Through the common mycorrhizal network, AM fungi can regulate plant community structure and succession, influence material cycling, energy flow, and signal transduction, and substantially affect ecosystem stability and function. Because the physiological and ecological functions of AM fungi could be predetermined by their ecological adaptability, understanding the AM fungal biodiversity in different ecosystems and their response to various environmental factors is important for the exploration and utilization of these biological resources. To date, many studies have revealed the influences of different ecological factors on AM fungal diversity, however, systematic studies on the ecological distribution patterns of AM fungi and the underlying mechanisms are still lacking. This paper summarized available knowledge regarding the influences of biotic and abiotic factors on AM fungal diversity and ecological distribution, and discussed AM fungal biogeography compared to macroorganisms. Prospects in this research area were also proposed to promote future research.