Agriculture is characterized by a growing use of chemicals, such as fertilizers, pesticides and herbicides that are negatively affecting human health and the environment. Despite that, the Ethiopian government promotes the use of those chemicals in an attempt to increase yield and improve farmer’s livelihoods. On the other hand, environmental researchers argue that, equivalent yield can be obtained by using sustainable agricultural practices and produce safe food. Unfortunately, the “traditional” sustainable agricultural practices are being replaced by chemical intensive practices as the later is largely promoted. Therefore, it is important to trigger policy towards the promotion of “traditional” sustainable agricultural practices through research. This study, by using 299 randomly selected households from Eastern Ethiopia, unravels the factors that influence the use of crop rotation in Eastern Ethiopia. The results can serve policy makers by identifying the relevant variables and help them design successful intervention strategies. Based on the result, older age (older than 37 years), use of irrigation, distance to FTC, land size and farmers perception towards soil fertility are found to positively affect the decision to practice crop rotation. On the other hand, young age (younger than 37 years) and distance from market are found to hinder the decision of farmers to practice crop rotation. Sustainable agriculture can be brought back on track by creating a platform for older farmers to share their experiences with younger farmers and diverting some of the attention given to chemical fertilizers towards the “traditional” and sustainable practices.