Cadmium (Cd) intake is harmful to human health and Cd contamination in rice grains represents a severe threat to those consuming rice as a staple food.  Knockout of Cd transporters is a promising strategy to reduce Cd accumulation in rice grains.  OsNRAMP5 is the major transporter for Cd and manganese (Mn) uptake in rice.  Nevertheless, it is uncertain whether knockout of OsNRAMP5 is applicable to produce low Cd rice without affecting plant growth and grain yield.  In this study, we adopted CRISPR/Cas9-based gene editing technology to knock out OsNRAMP5 in two japonica varieties.  We generated three independent transgene-free osnramp5 mutants and investigated the effect of osnramp5 mutations on Cd accumulation and plant growth.  Hydroponic experiments showed that plant growth and chlorophyll content were significantly reduced in osnramp5 mutants at low Mn conditions, and this defective growth in the mutants could be fully rescued by supply of high levels of Mn.  Cd and Mn accumulation in both roots and shoots was markedly reduced in the mutants compared to that in wild-type plants.  In paddy field experiments, although Cd in flag leaves and grains was greatly reduced in osnramp5 mutants, some agronomic traits including plant height, seed setting rate, and grain number per panicle were affected in the mutants, which ultimately caused a mild reduction in grain yield.  The reduced plant growth in the mutants can be attributed to a marked decrease in Mn accumulation.  Our results reveal that the manipulation of OsNRAMP5 should be treated with caution: When assessing the applicability of osnramp5 mutants, soil pH and soil water content in paddy fields need to be taken into consideration, since they might affect the levels of available Mn in the soil and consequently determine the effect of the mutation on grain yield.