Microsoft's own docs say you can just pull the drive, but the Safely Remove icon in my taskbar never left.