The development of specialty agriculture is of great significance to western China’s agricultural structure adjustment, and it’s an essential way for the construction of ecological agriculture in Southern Ningxia mountainous area. This paper makes a summary about the development status of specialty agriculture in Southern Ningxia Mountainous Area and put forward the basic benefit goal and problems needing attention. On this basis, the paper studies the development pattern of specialty agriculture in Southern Ningxia Mountainous Area from the aspects of production factors and industry. This paper suggests that the development pattern of specialty agriculture in Southern Ningxia Mountainous Area should combine the regional agricultural pattern and innovative organization structure pattern, demonstration agriculture and market-directing pattern, engineering agricultural pattern and enterprise-driven pattern. The development of specialty agriculture in Southern Ningxia Mountainous Area should promote the three patterns, in order to achieve the construction of ecological agriculture and agricultural structure adjustment.