The retime markers persist in the graph view as long as you keep the same object(s) selected. You can change tools in the Graph Editor, then switch back to the Retime Tool and continue to adjust the markers.
To delete a retime marker
To clear all retime markers from the graph view