Only shut it down on the factory if internally initialized and make sure we properly close it on the config.