You can control whether light icons are displayed in the modeling windows.
Select WindowDisplay > Toggles > Lights.
Select WindowDisplay > Toggles > Lights .