Answer by jaskij

Try putting a script on the camera (if the SkyBox is camera specific) and changing it's gameObject.active. If that doesn't work, make two cameras, of which only one has a skybox and switch between them (I know it's a PITA). Or use a script to change the material of the skybox component on the camera through a script.