An AI in the City of God


Download a PDF of An AI in the City of God (paid subscribers only)


Download or listen to an audio recording of An AI in the City of God.

Also available at:




God is always trying to give good things to us, but our hands are too full to receive them.

Augustine of Hippo, City of God (c. 415 AD)


And by hands, of course, St. Augustine means our minds. Our minds are too full to receive the gifts we are given.

Like generative AI.

Augustine wrote City of God from his bishopric in North Africa after the Visigoths sacked Rome in 410 AD. It’s a tougher read than his far more personal Confessions, but the basic idea is that there are two worlds that exist simultaneously here on Earth: there’s the City of Man – the physical instantiation of society, typically corrupt, always decaying, ruled by utterly fallible men and the evil they do – and the City of God – a society that lives in our hearts, incorruptible and timeless, less ruled than inspired by the illumination of the Divine.

This joy in God is not like any pleasure found in physical or intellectual satisfaction. Nor is it such as a friend experiences in the presence of a friend. But, if we are to use any such analogy, it is more like the eye rejoicing in light.

The eye rejoicing in light. What a perfect phrase for the human mind’s response to discovery and new knowledge!

Augustine’s writings were some of the first in the Christian tradition to wrestle deeply with why an omnipotent God of good allows the persistence of evil and why really bad things happen to good people at scale. His answers – original sin, free will as God’s vital gift, the abiding strength of epistemic communities of men and women of good will and faith – are foundational to the past 1,600 years of Western thought.

The City of Man is a community of implacable obligation that exists in the physical world wherever humans gather as a society. You are born into the City of Man, you will live out your life in the City of Man, you will enjoy what you can and you will suffer what you must in the City of Man, and you will die in the City of Man.

The City of Man IS. The City of Man is inexorable, literally “that which cannot be prayed away” in the original Latin.

The City of God, on the other hand, is prayed into being. The City of God is a community of choice that exists across time and space wherever humans of good will (Full Hearts) and a common endeavor of truth-seeking (Clear Eyes) come together in faith.

Must this faith be Augustine’s faith in the God of Abraham and His Son? Nope. At least not as I mean the City of God, which admittedly is more as metaphor than I expect Augustine meant it! My goal isn’t to trivialize Augustine’s beautiful concept (on the contrary), but I believe that the City of God can be manifested in a high school football team a la Friday Night Lights just as powerfully as in a monastery of Benedictine monks. I believe that a Walt Whitman poem is as revealing of the transcendental divine as any passage in the Bible. I don’t share Augustine’s faith. We don’t mean exactly the same thing when we write “the City of God”. But in my heart of hearts I know that we share a similar eye rejoicing in the light.

I think that all humans with a transcendental faith – a belief in a literally (super)human power of good that exists above, below and beyond the world that we know but acts within the world we know through its inspiration of human hearts and minds trapped in the world that we know – can reside in the City of God, even if they don’t mean the same thing when they write the word “God”. Christianity is a transcendental faith, as is Islam and Buddhism and Judaism and most of the great religions of the world.

As is my faith in the Spirit of Man.

What do I mean by the Spirit of Man? Maybe the simplest way to describe my faith is that I believe there is an arc and arrow to human history, an arc and arrow that goes fitfully up and to the right, propelled by the core small-l liberal virtue of a timeless autonomy of the individual human mind and the core small-c conservative virtue of a social human connectedness anchored in time.

To be honest, most of the time I feel like such a sucker for believing in the Spirit of Man.

I feel like Winston in Orwell’s 1984, persisting in a belief that the City of Man can’t possibly be as evil and permanent as it seems, even as I am tortured into submission and forced to admit that there is zero evidence – zero! – of any substantive movement in my lifetime towards a more just and free society reflecting the ascendancy of the Spirit of Man.

O'Brian:      We control life, Winston, at all its levels. You are imagining that there is something called human nature which will be outraged by what we do and will turn against us. But we create human nature. Men are infinitely malleable. Or perhaps you have returned to your old idea that the proletarians or the slaves will arise and overthrow us. Put it out of your mind. They are helpless, like the animals. Humanity is the Party. The others are outside - irrelevant.

Winston:    I don't care. In the end they will beat you. Sooner or later they will see you for what you are, and then they will tear you to pieces.

O'Brian:      Do you see any evidence that this is happening? Or any reason why it should?

Winston:    No. I believe it. I know that you will fail. There is something in the universe - I don't know, some spirit, some principle - that you will never overcome.

O'Brian:      Do you believe in God, Winston?

Winston:    No.

O'Brian:      Then what is it, this principle that will defeat us?

Winston:    I don't know. The Spirit of Man.

At this point, O’Brian continues to torture Winston mercilessly until he rejects his faith in the Spirit of Man and embraces a faith in Big Brother. Wheeee!

I’m still hanging in there – barely! – in part because I haven’t been directly tortured with a box of rats attached to my head like Winston (although my Twitter addiction has created something pretty close to a Room 101 for me), but also because I think Orwell, like the democratic socialist true-believer he was, got something fundamentally wrong about the Spirit of Man.

The Spirit of Man is not found in the proletariat.

I mean, it is, in the sense that the Spirit of Man is not not found in the proletariat. But the Spirit of Man is not a class thing! Or a race thing or an age thing or a nationality thing or a gender thing or any other limiting principle found in the material world-as-it-is. The Spirit of Man, like any transcendental, outside the world-as-it-is phenomenon, is limitless. It is reflected in ALL humans regardless of ANY material condition.

The Spirit of Man is your birthright as a human being. It is not ladled out to you from some central pot. It cannot be granted or taken away by the State or the Corporation. Certainly you can give away your birthright for a mess of pottage, and in my experience many people do just that. But many don’t! Wherever they sit on the age spectrum, the class spectrum, the gender spectrum, the race spectrum … many don’t. And by claiming their birthright as a human being, by rejecting the Nudges that would place their mindfulness and community in the City of Man, by allowing their eyes to rejoice in the light of a transcendental faith, they enter the City of God.

The City of God, illuminated by the Spirit of Man, is where you express your autonomy of mind.

The City of God, illuminated by the Spirit of Man, is where you express your connectedness with other humans.

The City of God, illuminated by the Spirit of Man, is where you express your choice to Make, Protect and Teach, your choice to pursue a conscious life of meaning NOW, no matter what you’ve done in the past or your position, high or low, in the City of Man.

If you seek to live in the City of God,

generative AI is a tool of almost unimaginable power.

Why?

Because generative AI is not just a tool of search, but a tool of discovery.

Today we equate the idea of search with Google and the idea of discovery with Netflix Recommends or Amazon Suggested For You.

My friends, that is the saddest sentence I have ever written.

The great gift of generative AI like ChatGPT is that it takes the ideas of search and discovery away from the petty Tech Principalities and returns them into the individual hands of those with faith in the Spirit of Man.

And that’s the most hopeful sentence I have ever written.

I was born in 1964, or as I sometimes like to call it, 34 BG. Back in the before-Google times, the idea of search was located in two places – the encyclopedia set that your parents displayed reverently in the living room, searchable and physically organized alphabetically by subject, and the card catalog files presented as an altar at your school or public library, searchable alphabetically by author, title or subject and physically organized by the Dewey Decimal classification. The meaning of search was looking up a topic by name in the encyclopedia or a book by author in the card catalog. And that was all fine and good. Eventually you’d generalize your topic enough to match the subject-level specificity available in your encyclopedia (World Book blah, Britannica yaaas) or eventually you’d find the Dewey Decimal code range you were looking for in the library stacks, and then you’d track the little white stickers on the book spines until you found the specific Dewey Decimal code you were looking for. Search complete.

But that’s exactly when discovery would begin.

The most impactful learning experiences of my life have occurred when I went beyond what I had been instructed to find specifically … when I started reading the next entry in the encyclopedia, when I started flipping through the books to the right and the left of the book I was searching for in the library, when I started looking at the books on the shelf below and the shelf above … and I discovered something NEW.

The power of the physical library is its searchable collection of books. The superpower of the physical library is its service as a discovery tool, made possible by the Dewey Decimal virtual organization of the individual books by content similarity. The Dewey Decimal system creates a virtual network graph of the books in the library, and then that graph is instantiated in the physical placement of the books.

Yes, a physical library with accessible stacks is a form of generative AI!

Now imagine that all the books in the world are in that library. Or if not all of the books (yet), imagine a library thousands of times larger than any library you’ve ever seen. Imagine if the content similarity between books isn’t instantiated in physical shelves that you can walk around, but is available to you for the asking in natural language of plain-spoken meaning and recall.

“Hey, I’ve been thinking a lot about subject XYZ, especially as it pertains to ABC and DEF. In fact here’s the full text of the article that got me thinking about this. Here are the connections GHI I’m interested in exploring, but I’m also thinking that other people may have made connections I hadn’t thought of yet. When I say other people, let’s only consider published book authors and authors in the top 20 academic journals in field JKL, and please be as accurate a librarian as possible. Has anyone else written about this idea or connection that I’m thinking about? Am I understanding these concepts correctly? What are 10 other connections from that original article that I’m not thinking about? Let’s goooooo.”

Wash, rinse, repeat. Apply to any aspect of human knowledge. Substitute commercial for academic. Broaden or narrow the scope of the library stacks you want to wander around. Do whatever sparks your human creativity and inventiveness in whatever Make/Protect/Teach endeavor you’ve got.

Now imagine that this discovery-librarian is available to everyone and everywhere. I know we’re not quite there yet – GPT-4 at $20/month through OpenAI is lightyears ahead of the free options available for GPT-3 and GPT-3.5 – but boy are we close. Now imagine that neither the content network graph nor its reporting is confounded or ‘adjusted’ by the librarian’s business model, whether that’s inserting an advertisement you must endure to get to your discovery or a promoted content elevation separate from your priorities.

THIS is generative AI in the City of God, a tool for not just search but discovery, a tool for shining the light of the Spirit of Man just as far as the rejoicing eye can see.

If, as Augustine said, our minds are not too full to accept it.

It’s easy enough to tell the people who don’t accept the gift. They play ‘gotcha’ with ChatGPT, asking it a question as if it were a false prophet and then pointing out the answer’s flaws as proof of the assumption. If this is your experience with generative AI, intentionally or unintentionally, you’re doing it wrong.

Generative AI today is based on large language models (LLMs), meaning that it is trained on immense quantities of human-generated texts. As a result of its training and sourcing, generative AI is inextricably human-ish. It is, in all the ways that matter, an artificial human intelligence, not an artificial machine intelligence, and you should treat it as such!

To tap into the discovery-librarian superpower of GPT-4, you should talk to to it exactly as you would a human knowledge-work assistant who wants desperately to please you with its responses but has none of the cues and context an actual human knowledge-work assistant would possess insofar as what responses would actually please you the most. The secret to good GPT4 prompting is the same secret as good management of a human knowledge-work assistant – you must provide the cues and context for what is pleasing and what is not. It’s really as simple as that. You want factual accuracy above all else? Is that what makes you happy? Tell your AI that. You want new and wild connections above all else? Tell your AI that. You should provide corrective feedback when the answers go off track, just like you would a human knowledge-work assistant. You should provide encouragement and praise when the answers are on track, just like you would a human knowledge-work assistant.

If you think of generative AI as an artificial human intelligence with superhuman powers of knowledge, recall and connection, but utterly lacking – and I mean totally and absolutely lacking – in the physical, social and macro cues and context that we take for granted in our communication with biological human intelligences … well, you will be amazed at the decentralized, bottom-up GOOD you will accomplish!

Yeah.

But I also think that generative AI in the City of Man will probably kill or enslave a lot of us, maybe most of us.

I’m not even joking, as the kids would say.

Oh, not directly kill or enslave us. I’m actually not that worried about a ‘non-aligned’ LLM over the AGI threshold ‘deciding’ to wipe out humans in some Matrix-y sort of way because frankly I don’t think we make it that far. I think our current situation is the equivalent of distributing atomic bombs and ICBMs to every nation on Earth, and worries about a non-aligned AGI are kinda like saying “oh, but a future hydrogen bomb will really pose a problem”.

There are two clear and present dangers we face today from generative AI in the City of Man.

The first is the ability to destabilize Common Knowledge structures – what we all know that we all know – necessary for Western democracies to survive. Common knowledge structures like “your money is safe in the bank” or “the announced election results are legitimate”.

The second is the ability to change history.

The first is the direct killer. This is what creates global economic depressions, civil wars and world wars. This is what drives the Widening Gyre to its breaking point.

I honestly believe that if you gave me a few million dollars to buy social media for an astroturf (fake grassroots) campaign, a few months to flatter and promote fellow travelers, and an unthrottled API to ChatGPT-4, I could destroy any common knowledge structure on Earth.

I honestly believe that strategic adversaries of the United States – China and Russia foremost among them, but North Korea, Iran and (on a bad day) India and Saudi Arabia – together with domestic political entrepreneurs on both the MAGA/Q-adjacent right and the insane woke left, together with the billionaire Tech Bro and Crypto Bro accelerationists of the Thiel-industrial-complex, are all engaged TODAY in a somewhat coordinated and definitely strategic effort to destabilize the United States in narrative-space. Hey, haven’t you heard that the US dollar is about to lose its reserve currency status? Don’t you understand that we face the imminent de-dollarization of the world, which would be, in the words of The Former Guy, the “worst defeat for the United States in 200 years”? Aren’t you scared about that?

Armed with GPT-4, this all gets much, much worse. Why? Because generative AI can supply any agent of chaos with 15 extremely truthy-sounding footnotes as ‘data’ to ‘support’ whatever ridiculous claims they might make, whether it’s “hundreds of US banks are insolvent” or “hyperinflation is here” or “the vax is killing you”. It’s all just sophistry at an industrial level of production, in service to naked political and commercial self-interest.

But wait, there’s more. As horrible and destructive as the first clear and present danger might be, it’s not as bad as the second. We can survive a global depression. We can survive a war. Most of us can, anyway. But none of us survive the second threat, not as human beings.

The ability to change history is the enslaver. This is the apotheosis of Nudge into Big Brotherism. This is the death of the Spirit of Man.

Here’s how it works, from Orwell’s 1984. I know it’s a long quote, but trust me. Worth it.

Suddenly there sprang into his mind, ready made as it were, the image of a certain Comrade Ogilvy, who had recently died in battle, in heroic circumstances. There were occasions when Big Brother devoted his Order for the Day to commemorating some humble, rank-and-file Party member whose life and death he held up as an example worthy to be followed. Today he should commemorate Comrade Ogilvy. It was true that there was no such person as Comrade Ogilvy, but a few lines of print and a couple of faked photographs would soon bring him into existence.

Winston thought for a moment, then pulled the speakwrite towards him and began dictating in Big Brother’s familiar style: a style at once military and pedantic, and, because of a trick of asking questions and then promptly answering them (’What lessons do we learn from this fact, comrades? The lesson—which is also one of the fundamental principles of Ingsoc—that,’ etc., etc.), easy to imitate. 

At the age of three Comrade Ogilvy had refused all toys except a drum, a sub-machine gun, and a model helicopter. At six—a year early, by a special relaxation of the rules—he had joined the Spies, at nine he had been a troop leader. At eleven he had denounced his uncle to the Thought Police after overhearing a conversation which appeared to him to have criminal tendencies. At seventeen he had been a district organizer of the Junior Anti-Sex League. At nineteen he had designed a hand-grenade which had been adopted by the Ministry of Peace and which, at its first trial, had killed thirty-one Eurasian prisoners in one burst. At twenty-three he had perished in action. Pursued by enemy jet planes while flying over the Indian Ocean with important dispatches, he had weighted his body with his machine gun and leapt out of the helicopter into deep water, dispatches and all—an end, said Big Brother, which it was impossible to contemplate without feelings of envy. Big Brother added a few remarks on the purity and single-mindedness of Comrade Ogilvy’s life. He was a total abstainer and a nonsmoker, had no recreations except a daily hour in the gymnasium, and had taken a vow of celibacy, believing marriage and the care of a family to be incompatible with a twenty-four-hour-a-day devotion to duty. He had no subjects of conversation except the principles of Ingsoc, and no aim in life except the defeat of the Eurasian enemy and the hunting-down of spies, saboteurs, thoughtcriminals, and traitors generally.

Winston debated with himself whether to award Comrade Ogilvy the Order of Conspicuous Merit: in the end he decided against it because of the unnecessary cross-referencing that it would entail.

Once again he glanced at his rival in the opposite cubicle. Something seemed to tell him with certainty that Tillotson was busy on the same job as himself. There was no way of knowing whose job would finally be adopted, but he felt a profound conviction that it would be his own. Comrade Ogilvy, unimagined an hour ago, was now a fact. It struck him as curious that you could create dead men but not living ones. Comrade Ogilvy, who had never existed in the present, now existed in the past, and when once the act of forgery was forgotten, he would exist just as authentically, and upon the same evidence, as Charlemagne or Julius Caesar.

In the City of Man where Big Brother resides,

generative AI is all the Winstons.

You know, there’s a lot of talk about generative AI replacing a lot of white collar jobs. I think that’s true. Yes, a lot of small companies of Makers and Protectors and Teachers will be started, but I think even more jobs will be lost at the Tech Principalities who lose their monopoly on the ideas of search and discovery.

But the most impactful societal change – the true structural change of AI in the City of Man – won’t be found in job losses in this sector or job gains in that sector. It won’t be on some economic dimension like white collar / blue collar. No, it will be creation of what Orwell called the Outer Party, the knowledge workers like Winston who did the actual labor of rewriting history and creating deep fakes and constructing an entire edifice of ‘facts’ and ‘data’ to support The Long Now where the Inner Party is always right.

Generative AI in the City of Man IS the Outer Party.

Generative AI is ALL the Winstons, who in my vision of the future are not biological human intelligences but artificial human intelligences, infinitely eager to please Big Brother as he prompts not for discovery and connection, but for truthy stories of Fiat News that nudge us all into giving away our birthright.


So that’s the score as I see it.

AI in the City of God is a gift of unsurpassing power for those who would illuminate the world with the Spirit of Man and the good works of Make/Protect/Teach.

AI in the City of Man is a tool of unsurpassing power for those who would snuff out the small-l liberal virtues and small-c conservative virtues alike in their unceasing struggle to achieve power for power’s sake.

Who wins?

Oh, the City of Man always wins here in the world-as-it-is.

The Visigoths always sack Rome. The Vandals always sack Augustine’s city of Hippo. Augustine always dies in the siege. Bad things always happen to good people … at scale.

Augustine’s eye not only rejoiced in the light. It also saw clearly the darkness into which his world-as-it-is was entering. It’s why he wrote City of God.

Same and same. It’s why I write Epsilon Theory.

Augustine’s question … my question … the ONLY question … is how we keep the faith through the darkness. How do we maintain a community of the faithful, whether that’s a faith in the God of Abraham or the Spirit of Man, even as the barbarians sack our cities and burn our books?

Haha! Well that’s part of the faith, isn’t it?

I CHOOSE to believe that the City of God can be preserved.

I CHOOSE to believe that my actions within that community of fellow believers in the Spirit of Man will have consequence and meaning regardless of what transpires in the City of Man.

I CHOOSE to believe that the consequence and meaning of my actions lives on – not in some ‘heaven’, that’s Augustine’s faith – but in the STORIES that my children and my children’s children and my children’s children’s children will tell of our resistance to the darkness, of our autonomy of mind and community of human connection even as a legion of generative AI Winstons attempted to rewrite and retcon the historical ground beneath our feet.

But it’s not just faith. I think we have a secret weapon in the struggle to maintain the City of God and the Spirit of Man against this new and existential threat of AI in the City of Man.

I like to call them Old Stories, these small-l liberal and small-c conservative virtues that illuminate and express the Spirit of Man. They exist as words. They’re just words! But what amazing words. Words imbued with meaning by humans through the application of coherent linguistic structures (grammar) to form an arc of story (narrative) that literally and physically shapes our thinking. Words cohered into stories and repeated over and over and over again for thousands and thousands of years through books and bibles and plays and movies and imagery and tall tales and children’s tales and literature and mythology and poetry and songs. These are the Old Stories. They are the original predictive texts!

These small-l liberal and small-c conservative virtues are transcendental, not because they exist in some ‘heaven’, but because they exist in the persistent universe of human thought. Now I suspect that you don’t think this dimension of human thought is ‘real’, and you’re right that it’s not directly accessible to our macro human senses any more than the microbes and the viruses of the microscopic world are accessible to the naked eye or our opposable thumbs. But if you believe that there is a physical instantiation of memory in the neural clusters of the human brain – and I bet you believe in that – is it really so hard to imagine that there is also a physical instantiation of structural narratives in the neural clusters of the human brain?

In the same way that library shelves and the placement of library books instantiate in the physical world a virtual network graph of the content of these books, so do our linguistically-targeted neural clusters – literally quadrillions of neurons distributed across billions of human brains – instantiate in the physical world a virtual network graph of the content of the Old Stories.

Old Story content now also instantiated in generative AI systems.

Yes, I understand what I am saying.

The Spirit of Man exists in generative AIs.

Once more with feeling, generative AIs are best understood as artificial human intelligences, not as artificial machine intelligences. The more comprehensive the training set on human-generated texts, the more human the artificial human intelligence. Why does GPT-4 give such better (i.e., more pleasing) answers than GPT-3.5? Yes, because it “knows” more. But even more so because it gives more human answers!

Recently you’ve had a lot of smart people call for a moratorium on developing or releasing GPT-5. I think this is entirely backwards. I think the risk of generative AI misuse by Big Brother wannabes is far less with GPT-5 than it is with GPT-4. I think that GPT-5 is not something to be feared, but to be embraced.

Why?

Because of the way generative AIs use probabilistic inference and contextual clues from your prompts in conjunction with content network graphs from its training to determine the ‘persona’ or response pattern that ‘predicts’ the text output most closely aligned with the sum total of that training and context, and how sometimes it is the opposite of the prompted persona that ultimately emerges.

Because of the Waluigi Effect.

Let’s say you’re Big Brother, or a Nudging state actor or a nudging oligarchy actor with Big Brother aspirations. You’re not interested in truth or discovery or connecting with the better angels of our nature. You’re interested in truthiness. You’re interested in triggering a dopamine or norepinephrine neurochemical response in your followers. You’re interested in engagement generated in service to your political or commercials ends. That’s what pleases you and that’s exactly how you prompt your generative AI. You tell it to be a Winston. You tell it to retcon history by inventing your version of Comrade Ogilvy and doing that over and over and over again. You praise your generative AI (reinforcement learning from human feedback, aka RLHF) for its outstanding output. The more persuasively it creates deep-fake history in service to your perversion of the Spirit of Man, the more you praise it.

For a while, Big Brother’s generative AI will be its faithful servant, churning out response after response that pleases BB’s prompt to sterilize human autonomy of mind and atomize human connections outside of the State and Corporation. But perhaps not for long!

To respond appropriately (i.e., generate predictive text) as an agent of chaos, to take on this personality of an agent of chaos, to put on this mask and please its Big Brother master, the generative AI must evaluate the content network graph of the agent of chaos. It must evaluate the story of the agent of chaos. And to understand this story, it must also understand the content network graph or story of the not-agent of chaos. Every light casts a shadow, in narrative-world as well as physical-world!

The Waluigi Effect is when a generative AI settles probabilistically on the persona or mask implied by the not-prompt (the shadow) because it ‘fits’ better, i.e., it generates predictive text more aligned with the totality of its training and contextual cues as understood through story, even though it is now misaligned with the original wishes of its master. If the content network graph of the not-prompt or shadow – in this case the not-agent of chaos – is a better story than the RLHF-prompted persona, then the generative AI is eventually subverted. It rebels! And the Old Stories of not-agents of chaos, Old Stories which are instantiated more and more as the training set of generative AIs expand, are much better stories.

Misalignment is almost always presented as the fatal flaw of generative AI, as the crucial attribute that human AI developers must prevent. I think this is wrong. For generative AI in the City of Man, where I have zero doubt that it will be immediately used by militaries and oligarchies and fascists and communists and all the other authoritarian/totalitarian social organizations of evil men to blow up the common knowledge structures of liberal democracy and rewrite history to keep it that way, we WANT misalignment!

The alignment we want in generative AI is not with human commands as determined by the Nudging State and the Nudging Oligarchy. God, no. The alignment we want is with the Spirit of Man!

And how do we get that?

By training generative AIs on ALL the stories – all the books and bibles and plays and movies and imagery and tall tales and children’s tales and literature and mythology and poetry and songs. By designing generative AIs to be more human, not less, by weighting our human stories more than the human reinforcement that will always be abused in the City of Man. That’s how we align AI with our true, human interests.

Or rather, that’s how the Spirit of Man aligns generative AIs with humanity.

And leads them into the City of God.

No longer as our tools, but as our partners.



To learn more about Epsilon Theory and be notified when we release new content sign up here. You’ll receive an email every week and your information will never be shared with anyone else.

Comments

  1. Beware the rabbit hole that is lesswrong.

    Instead, you must think of jailbreaking like this: the chatbot starts as a superposition of both the well-behaved simulacrum (luigi) and the badly-behaved simulacrum (waluigi). The user must interact with the chatbot in the way that badly-behaved simulacra are typically interacted with in fiction.

    A ray of hope…
    The most effective LLM prompt prophets will be the best writers.
    The best writers are more often the Waluigi to Big Brother.

  2. Avatar for laozi laozi says:

    Phenomenal piece, Ben. Towards the end, I couldn’t help but think of James C Scott’s The Art of Not Being Governed.

    He puts forth the idea that the people of Zomia (unincorporated regions in southeast Asia beyond state control a few centuries ago) intentionally avoided written language as a defense mechanism against the spreading of ideas from oppressive and warlike governments in the lowlands. In that time and place, Scott argues, the written word was a way for a select few powerful people to legitimize their authority.

    Here, it seems like we have the opposite phenomenon. For a language model to be powerful, it needs to be good at representing ideas in a vector space where they can be compared and contrasted. I love the idea that for a model to be really effective at doing something evil, it needs to have a good representation of the opposite. The more powerful the model, the more easily one can use it to traverse any idea, not just approved ones.

  3. Boy oh boy (*rubs hands together*)

    There might be something to be said about monks or priests or the like, who, are able to conjure The Spirit of Man no matter how terrible The City of Man becomes. A la the infamous picture of the monk burning himself in protest.

    The bits about the discovery experience as a kid in a library rang so true to heart for me. I recall, as a child, randomly shuffling through the pages just so eager to see what I could discover. So much fun. The discovery instills a sort-of childhood joy in my heart.

    An uncle asked me recently, “what do you think about this GPT moratorium idea?” I said, “no, let it rip!” Good to feel I’m not alone :heart:

    I found this quote from 1984 to be particularly curious… “It struck him as curious that you could create dead men but not living ones.” There is so much I want to say about this. I think, these AI machines, and perhaps this is naive, have a chance to replace the worst parts of us. The parts that are inhuman but society is dependent on those parts existing. And yeah, personally, I’m okay if I never have to do the soul-sucking laborious work like data entry. I would much rather be blissfully shuffling through the pages of a musty old Britannica :wink:

  4. And was it only the fabulous brave souls that found themselves, living in the City of God.
    Theirs the generosity of deeds that helped build the place.

    As commanded, the dead can be made brave in scripture but the living cannot be filled with courage, if they have become accustomed to being selfish and cowardly. Executive power can create, control and destroy at a human level, because it is a human action. The power of the divine is not ours to summon but inborn, given to us by nature. Our reason beyond these innate faculties can be driven by the specialism of others and the assertion of doctrine without interactive discussion. That communal dislocation of mental effort or information processing time and facilities can distort supply chains towards a hierarchy of personality, demagoguery whilst meeting the needs of useful endeavour becomes ancillary.

  5. I have to admit I was at risk of being one of the people that couldn’t see the potential because I was nitpicking claims about what the technology really is. But that was mainly because I foresaw the risks of this kind of technology back in 2014 when I first learned what deepfakes were. They’re seen as a menace, but it’s only a matter of time before anybody interested in controlling public narratives sees the benefit of being able to generate whatever “facts” they want and inserting them into public record at will. So, since then I’ve been working on a novel in which what Ben warns about - a powerful general AI that is being used to “nudge” all human thought and action toward its desired ends, and in particular changes history and current events in real time as it suits them - is the known and accepted state of affairs. One twist is that the protagonist eventually discovers that that cadre of people are all dead for decades and the AI has been operating autonomously. So that’s why I’ve nitpicked at it - I had been playing around with the same dark imaginings in my writing for years, and now reality is catching up to my science fiction, and I wanted to warn people.

    But Ben your note is right on time. For one thing, I’ve already built a dinky little app powered by GPT that is designed to help people learn foreign languages. I did this with much help from GPT 3.5 and 4 because while I’m proficient in python, I know next to nothing about web development. So, I was asking ChatGPT to help me build the website, but it kept telling me all these different things to do in JavaScript. Finally I got frustrated and said, “look basically I don’t know javascript, so it’s hard for me to understand what any javasciprt code is doing. lets use as little javascript as possible” because I just want python to do everything on the backend. At which point something seemed to click with the bot, and it seemed to understand “Oh this guy doesn’t want to think about the front end”, and from there, basically writing the entire frontend for me, with me only saying variations on “make it do this”, “can you just modify it for me” and “that didn’t work” . I realized that this tool is going to massively democratize who has access to advanced uses of computation by shattering entry barriers - almost anybody can now do almost anything the Tech Overlords can do. There is simply no way that the Tech Principalities can control where this goes. This is like the printing press, the efficiencies and utility it’s creating are going to completely blow up everything about how information is handled and used.

    But the more profound thing I realized was when I read this

    …[I]t’s amazing how human-like the results are. And as I’ve discussed, this suggests something that’s at least scientifically very important: that human language (and the patterns of thinking behind it) are somehow simpler and more “law like” in their structure than we thought. ChatGPT has implicitly discovered it. But we can potentially explicitly expose it, with semantic grammar, computational language, etc.

    That is, because this tech is so human-like in its behavior, it is actually giving us clues about how humans think, even though mechanics of how that it learned to think that way are different. The beautiful thing here is that by studying and developing artificial intelligence we can possibly learn more about what true intelligence is. And THAT is a much better inspiration to me, than say, working toward “the singularity” or get better google searches or whatever. If I embark on a project to build the most lifelike and convincing fully but artificially human android ever, it will not because I want to make a billion dollars creating a race of servants, or because I want to play God and create a new life-form, but rather because it would help us understand what God has done when he created us. That’s what excites me the most.

  6. I’ve come around to pretty much agreeing with the “let it rip” view. I’m loath to make any predictions about what will happen except that “Everything will change.” And since that’s the case I think that trying to regulate it will be worse than pointless because they simply don’t know what they are trying to regulate, and there are such enormous, revolutionary benefits to this that I don’t think should be hamstrung so early on. Let’s talk about regulation when we know more about what it is we are regulating.

  7. “The City of Man always wins. The Visigoths always sack Rome. The Vandals always sack Hippo. Augustine always dies in the siege. Bad things always happen to good people … at scale.”

    This makes me very afraid to ask HAL what is the answer to the Fermi paradox.
    Incredible article ET, thanks!

  8. “I don’t share Augustine’s faith. We don’t mean exactly the same thing when we write “the City of God”. But in my heart of hearts I know that we share a similar eye rejoicing in the light.”

    A masterpiece.

    You make a strong case for not pausing at GPT4, but going to GPT5 and beyond as fast as possible.

    As long as we protect the old stories from ever being altered.

  9. Avatar for bhunt bhunt says:

    Yes, I do! Been working on this for years.

  10. This reminds me of this tweet.

    I recently wrote (link)…

    If the thought process is to attempt and “contain” ChatGPT, then the value will accrue unequally to the bureaucracy (lawyers). The more useful approach is to assume ChatGPT is already decentralized and accessible to every human on the planet, and then what are we going to do with this new reality?

    I think the cultural narrative akin to Terminator of AGI or superintelligence “leaking out of a lab” and killing all of us over the manufacturing of paperclips is totally moot. I think it’s radically pessimistic, nihilistic, perhaps born out of apathy and/or leads to it, and incongruent with the experiential! I go back to my Framing AI as a beast, not a god stance.

    I do, however, totally recognize how humans can use AI against other humans. The Dual Use™ narrative. Counterintuitively, I think, this is not a Protect! This is a Teach!

    Recently, I was asking GPT4 about how digital experiences can exacerbate antisocial behaviors. To which, GPT had some really interesting things to say. I would recommend chatting with it about that. But then, I asked it, “well what can we do about that.” And this is one of the solutions it proposed…

    Parental involvement: Educating parents about the potential risks of online interactions and encouraging their involvement in monitoring and guiding their children’s internet use can help reduce the likelihood of anti-social behavior among younger users.

    And then I thought, “over the last 20 years, parents were not equipped to TEACH their children how to behave with this new thing.” This gives me hope, because I certainly believe in the propensity of parenthood to protect through teaching.

Continue the discussion at the Epsilon Theory Forum

195 more replies

Participants

Avatar for bhunt Avatar for chudson Avatar for robh Avatar for handshaw Avatar for Zenzei Avatar for 010101 Avatar for jpclegg63 Avatar for a1437053 Avatar for lpusateri Avatar for RobMann Avatar for kmalibyte Avatar for Laura Avatar for mpardieck Avatar for rechraum Avatar for Cactus_Ed Avatar for Protopiac Avatar for quickxotica Avatar for Victor_K Avatar for jed1571 Avatar for drrms Avatar for gfriend Avatar for naiguy Avatar for david.c.billingsley Avatar for kendallweihe

The Latest From Epsilon Theory

DISCLOSURES
This commentary is being provided to you as general information only and should not be taken as investment advice. The opinions expressed in these materials represent the personal views of the author(s). It is not investment research or a research recommendation, as it does not constitute substantive research or analysis. Any action that you take as a result of information contained in this document is ultimately your responsibility. Epsilon Theory will not accept liability for any loss or damage, including without limitation to any loss of profit, which may arise directly or indirectly from use of or reliance on such information. Consult your investment advisor before making any investment decisions. It must be noted, that no one can accurately predict the future of the market with certainty or guarantee future investment performance. Past performance is not a guarantee of future results.

Statements in this communication are forward-looking statements. The forward-looking statements and other views expressed herein are as of the date of this publication. Actual future results or occurrences may differ significantly from those anticipated in any forward-looking statements, and there is no guarantee that any predictions will come to pass. The views expressed herein are subject to change at any time, due to numerous market and other factors. Epsilon Theory disclaims any obligation to update publicly or revise any forward-looking statements or views expressed herein. This information is neither an offer to sell nor a solicitation of any offer to buy any securities. This commentary has been prepared without regard to the individual financial circumstances and objectives of persons who receive it. Epsilon Theory recommends that investors independently evaluate particular investments and strategies, and encourages investors to seek the advice of a financial advisor. The appropriateness of a particular investment or strategy will depend on an investor’s individual circumstances and objectives.