The retime markers persist in the graph view as long as you keep the same object(s) selected. You can change tools in the Graph Editor, then switch back to the Retime Tool and continue to adjust the markers.
To delete a retime marker
at the bottom of the marker. To clear all retime markers from the graph view