Use the Delete item to delete the active Feature Group and its contents.
To delete the active Feature Group click Feature Group tab > Active panel > Delete.