Use the Home tab > Delete panel > Items option to permanently remove selected objects from the model.
The objects are removed from the active model. If you want them back, use the Undo option on the Quick Access toolbar, otherwise the objects will be lost permanently.