Green manure (GM) application is an effective, eco-friendly method for improving crop yield and nitrogen use efficiency (NUE). However, the impacts of varying GM incorporation rates on nitrogen (N) loss, wheat grain yield, and NUE remain unclear, so a long-term field experiment was conducted in an oasis region from 2020 to 2023. The experiment aimed to determine the effects of different GM application rates on N loss in wheat fields and elucidate the underlying mechanisms. The experiment tested two N levels (N0 and N1, 0 and 180 kg ha–1, respectively) and four GM application rates (G0–G3, 0, 15,000, 30,000, and 45,000 kg ha–1, respectively). The study evaluated the impact of synthetic N fertilizer combined with varying GM levels on N losses, NUE, and wheat productivity. The relationships between N input, N losses, N use efficiency (NUE), and grain yield (GY) were also analyzed. The results showed that GM application significantly increased soil nitrate-N storage (0–100 cm), reduced the risk of N leaching into deeper soil layers, lowered N2O emissions, and simultaneously boosted the wheat GY, although it also increased NH3 emissions while NUE was improved. The N2O emissions from different amounts of GM retention were reduced by 14.1 to 19.0%, compared to N1G0. In the N0 treatment, a GM retention amendment increased the N2O flux by an average of 12.2% compared to N0G0. The NH3 emissions in the N0 and N1 treatments were first enhanced and then stabilized as the amount of GM increased. The highest GY and NUE were achieved with the N1G2 treatment. Simulations indicated that an optimal N input of 180 kg ha–1 synthetic N combined with 30,000 kg ha–1 GM was required to maximize both wheat yield and NUE, while minimizing apparent N losses. Therefore, the GM application strategy of N1G2 in this study can achieve a higher wheat yield, improve NUE, reduce N losses, and mitigate soil nitrate leaching. This management strategy provides key insights for achieving high crop productivity with minimal N loss, so it offers a practical solution for sustainable agriculture.