When you delete a curve, the tangents on either side of the curve are preserved. If the tangents were joined when they were created, the tangents are joined at the PVI after the curve is deleted.
If you do not see the button, click
Entity Based to change to an entity-based view.