Layers > Undo Assign

Revert your last Assign Objects operation.