Biodiversity and ecosystem services, a frontier and hotspot of international ecology and geography research, are key to realizing the healthy development of regional ecosystems. The well-being and survival of humanity depend upon the stability and sustainability of services provided by the agricultural landscape. This study systematically reviewed research on the effects of landscape heterogeneity on biodiversity and ecosystem services. We found that changes in the agricultural landscape pattern strongly impact regional biodiversity and ecosystem services. However, previous studies have focused more on spatial heterogeneity; research on the temporal and functional heterogeneity of landscapes still needs to be strengthened. In addition, the scale effects, differences in the large-scale landscape context, interspecific differences, and trophic cascade effects have significant, comprehensive, and interactive effects on the relationships between landscape heterogeneity and biodiversity and ecosystem services. In the future, research on how to ensure a stable and sustainable supply of biodiversity and ecosystem services through the methods of landscape reconstruction and agricultural landscape management at the regional scale should be further strengthened. Specifically, four potential limitations to further expansion must be addressed, including the effects of temporal and functional heterogeneity on biodiversity, ecosystem services and their thresholds at the landscape scale; the cross-scale, multi-factor, multi-species, and multi-scale integration and interactions; the trade-offs of different biological groups and different ecosystem services; and the trade-offs between improving landscape heterogeneity and decreasing the effective habitat area, as well as the loss of biodiversity caused by declining habitat area.