Conservation tillage, such as reduced tillage or no-tillage, may play an important role in increasing soil organic matter, reducing soil erosion, and providing a more complex and favorable habitat for soil-dwelling organisms. Aboveground arthropods are important components of ecosystems, promoting a number of key functions, such as decomposition of organic matter and some herbivorous pest control. The abundance and diversity of food web components depends highly on the rotation system and soil management. To reveal the effect of tillage regimes on the diversity and trophic structure of ground-dwelling arthropods under maize-soybean rotation in the black soil of Northeast China, five field investigations were conducted with three tillage regimes (no tillage, NT; ridge tillage, RT; mould board plough, MP) at a 13-year tillage regime experiment station. A total of 1002 arthropod individuals belonging to 3 classes, 11 orders, 29 families, and 37 groups were collected. Formica sanguinea Letreille, Lasius alienus Foerster, and Poecilus gebleri Dejean were the dominant species and accounted for 60.58% of the total individuals. The results showed that NT was beneficial to the spider population resulting in increased densities, and RT and MP significantly increased the density of Lasius alienus. Tillage regimes only significantly affected the density of arthropod communities in different growth stages (P < 0.05), whereas different growth stages of soybeans significantly or highly significantly affected the density, groups, and diversity of the arthropod community under different tillage regimes (P < 0.05; P < 0.001). In the long-term, under the maize and soybean rotation system, the proportion of trophic functional groups was different under the different tillage practices. The results indicated that the long-term conservation tillage (NT and RT) was more conducive to the survival of predators and herbivorous arthropods. Omnivores were dominant in the MP system, showing obvious adaptation to the unstable environment. In the different growth stages of the soybeans, the variation in all functional groups was not consistent, and there was no obvious pattern. It is obvious that no-tillage with rotation play an important role in maintaining the relationship between the species within the community and the trophic structure of the food web.