Layers > Custom Colors > Clear Layer Colors

Clears colors assigned to layers.