Taking the relevant data of 27 provinces in China during 2013 and 2017 as samples, this paper firstly measured the agricultural total factor productivity (TFP) using Manquist index method. Then, it built the panel data model, and empirically tested the impacts of agricultural TFP on the income gap between urban and rural residents. The results show that the improvement in agricultural TFP can promote the narrowing of the income gap between urban and rural residents, and the factors such as urbanization level and industrial structure also have significant impacts on the income gap between urban and rural residents. On the basis of these, it came up with recommendations, including increasing agricultural human capital investment and establishing agricultural production research institutions.