Color management can be enabled or disabled per scene.
The color management settings are stored in the scene. However, they may get overwritten when the scene is re-opened if you are using an OCIO configuration file or a color management policy.
Note that activating color management automatically enables Floating Point Render Target for Viewport 2.0, and sets Format to R32G32B32A32_FLOAT. You can change these settings if you experience performance problems with older graphics cards, but then you may see color clipping, banding, and other artifacts in the viewport. In addition, using the Eyedropper tool to pick colors in the viewport may result in incorrect color values.