Based on survey data of 9 poverty-stricken counties in Wumen mountainous area, using the ordinal Probit model, this paper analyzed the influence mechanism for the assessment of the implementation effect of the policy of relocating the poor. It obtained the following results. (i) Material security and social environment have a positive influence on the assessment of the policy of relocating the poor. (ii) In terms of material security, there is no significant relationship between the employment environment and the assessment of the policy of relocating the poor. Per capita annual income, per capita housing, income-increasing channels, and endowment insurance have significant effects on the assessment of the policy of relocating the poor. (iii) In social environment, public services, infrastructure, neighborhood relations, and environmental sanitation have significant effects on the assessment of the policy of relocating the poor, while there is no significant relationship between the awareness of poverty alleviation policies and the effect assessment of the policy of relocating the poor. (iv) The severer the poverty, the more significant the assessment of the implementation effect of the policy of relocating the poor. In accordance with the above results, it came up with recommendations for targeted poverty alleviation.