When the edges of a polygonal mesh are deleted using the key the selected edge is deleted but not the shared vertices at either ends of the edge. if you want to delete the shared vertices associated with the deleted edges you must use Edit Mesh > Delete Components. You can only delete interior edges on a mesh using the Delete Edge/Vertex feature.
To delete edges and the associated shared vertices
The selected edges and the associated vertices are deleted.
To delete border edges