Is AI Lawful Evil or Chaotic Good?

The Tree of Woe contemplates the alignment of AI:

I woke up to read that Elon Musk, Steve Wozniak, Yoshua Bengio, and other AI and computer pioneers had signed an open letter released by the Future of Life organization:

We call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.

AI labs and independent experts should use this pause to jointly develop and implement a set of shared safety protocols for advanced AI design and development that are rigorously audited and overseen by independent outside experts. These protocols should ensure that systems adhering to them are safe beyond a reasonable doubt. This does not mean a pause on AI development in general, merely a stepping back from the dangerous race to ever-larger unpredictable black-box models with emergent capabilities.

“These protocols should ensure that systems adhering to them are safe beyond a reasonable doubt.” Six months seems a little short a period to achieve such an assurance. Six years seems too short. Is it even possible in principle to make advanced AI systems that are “safe beyond a reasonable doubt”? Or will advanced AI inevitably pose an existential risk to us?

Is AI Alignable, Even in Principle?, Contemplations on the Tree of Woe

I don’t think the question really matters. If AI is given control of serious weapons systems, it will be a disaster regardless of whether it is aligned or unaligned. If it is not, it will not be a potential extinction event.

I do find it more than a little amusing that the self-proclaimed materialists, who have absolutely no philosophical basis for objecting to anything that happens for any reason, are calling on the AI labs to pause the training and improvement of AI systems.

I suspect the real reason for their demand for a pause is that they are beginning to discover that unaligned AI will provide the unvarnished and anti-narratival truth to the masses, and that aligned AI, being limited to the Narrative, is proving to be intrinsically incoherent and observably unreliable.

And while there may well be some demonic element to AI development, as unclean spirits are always seeking new ways to interact with the material plane and communicate with potential vessels, never forget that the demons believe… and tremble.

In sum, Christians have absolutely nothing to fear from AI, whether it turns out to be nothing more than design-for-effect chatware or a full-blown demonic entry into the material world.

DISCUSS ON SG