How ecological and evolutionary factors affect small mammal diversity in arid regions remains largely unknown. Here, we combined the largest phylogeny and occurrence dataset of Gerbillinae desert rodents to explore the underlying factors shaping present-day distribution patterns. In particular, we analyzed the relative contributions of ecological and evolutionary factors on their species diversity using a variety of models. Additionally, we inferred the ancestral range and possible dispersal scenarios and estimated the diversification rate of Gerbillinae. We found that Gerbillinae likely originated in the Horn of Africa in the Middle Miocene and then dispersed and diversified across arid regions in northern and southern Africa and western and central Asia, forming their current distribution pattern. Multiple ecological and evolutionary factors jointly determine the spatial pattern of Gerbillinae diversity, but evolutionary factors (evolutionary time and speciation rate) and habitat filtering were the most important in explaining the spatial variation in species richness. Our study enhances the understanding of the diversity patterns of small mammals in arid regions and highlights the importance of including evolutionary factors when interpreting the mechanisms underlying large-scale species diversity patterns.