If a durable good monopolist produces at constant marginal costs and the good depreciates, there exists a family of Strong Markov Perfect Equilibrium (SMPE) with an infinitesimal period of commitment. One member of this family entails instantaneous production of the level of stock produced in a competitive equilibrium; this is consistent with the Coase Conjecture. Other SMPE in the family entail steady state production at a stock level lower than in the competitive equilibrium. In these equilibria, there may be a jump to the steady state, or the steady state may be approached asymptotically. Monopoly profits are positive in these equilibria, and the Coase Conjecture fails. We contrast this result to other papers which use non-Markov strategies to construct multiple equilibria.