Go to the Options menu -> Video -> Advanced Video. Turn off "Cache Sun Shadows" and "Cache Spot Shadows." These settings are notorious for hogging VRAM and causing crashes on modern GPUs.