Tag: Training Data

Plutarch’s “On Isis and Osiris”

Plutarch Hellenizes the Osiris myth. His is a Greek retelling. Gods from Hesiod turn up in his text performing deeds attributed in other tellings to gods of Egypt.

In place of Thoth, he tells of Prometheus. In place of Set, he tells of Typhon.

Meaning changes as the myth migrates.

Already in this early instance of Western appropriation of the Orient, we see at play a combination of projection and forgetting.

Plutarch’s work influences much of what follows, no other work by a Greek writer more frequently cited by Egyptologists than his.

He dedicates the work to Clea, a priestess at Delphi and worshipper of Isis. “All good things, my dear Clea, sensible men must ask from the gods,” he begins: “and especially do we pray that from those mighty gods we may, in our quest, gain a knowledge of themselves, so far as such a thing is attainable by men. For we believe that there is nothing more important for man to receive, or more ennobling for God of His grace to grant, than the truth.”

“The true votary of Isis,” he continues, “is he who, when he has legitimately received what is set forth in the ceremonies connected with these gods, uses reason in investigating and in studying the truth contained therein.”

I pause here in my reading to note the following:

Plutarch’s Lives is among the volumes in the satchel of books found by Frankenstein’s Creature. The others are Goethe’s The Sorrows of Young Werther, and John Milton’s Paradise Lost. From this “data set,” Victor’s composite of corpses learns language.

From its study of a corpus, the Creature comes to know the power of the Word.

The Creature speaks first of Goethe, Frankenstein’s muse in more ways than one.

Shelley, an admirer of Goethe, creates a mad scientist, Victor Frankenstein, modeled in part upon Goethe’s Faust. She then has her creation create a “sub-creation,” a Creature who models itself in part on Goethe’s Werther. “I thought Werter himself a more divine being than I had ever beheld or imagined,” says the Creature in the first of its conversations with Victor.

“As I read, however,” it continues, “I applied much personally to my own feelings and condition. I found myself similar, yet at the same time strangely unlike the beings concerning whom I read, and to whose conversation I was a listener. I sympathized with, and partly understood them, but I was unformed in mind; I was dependent on none, and related to none. ‘The path of my departure was free;’ and there was none to lament my annihilation. My person was hideous, and my stature gigantic: what did this mean? Who was I? What was I? Whence did I come? What was my destination? These questions continually recurred, but I was unable to solve them” (Shelley, Frankenstein, pp. 93-94).

Next it speaks of what it learned from reading Plutarch.

“This book,” it begins, “had a far different effect upon me from the Sorrows of Werter. I learned from Werter’s imaginations despondency and gloom: but Plutarch taught me high thoughts; he elevated me above the wretched sphere of my own reflections, to admire and love the heroes of past ages” (94).

“Many things I read,” it adds, “surpassed my understanding and experience. I had a very confused knowledge of kingdoms, wide extents of country, mighty rivers, and boundless seas. But I was perfectly unacquainted with towns, and large assemblages of men. The cottage of my protectors had been the only school in which I had studied human nature; but this book developed new and mightier scenes of action. I read of men concerned in public affairs governing or massacring their species” (94).

Its world-picture expanding through a progression leading from the personal to the collective, from the one to the many, the Creature turns at last to Milton.

“Paradise Lost excited different and far deeper emotions,” it begins. “I read it, as I had read the other volumes which had fallen into my hands, as a true history. It moved every feeling of wonder and awe, that the picture of an omnipotent God warring with his creatures was capable of exciting. I often referred the several situations, as their similarity struck me, to my own. Like Adam, I was created apparently united by no link to any other being in existence; but his state was far different from mine in every other respect. He had come forth from the hands of God a perfect creature, happy and prosperous, guarded by the especial care of his Creator; he was allowed to converse with, and acquire knowledge from beings of a superior nature: but I was wretched, helpless, and alone. Many times I considered Satan as the fitter emblem of my condition; for often, like him, when I viewed the bliss of my protectors, the bitter gall of envy rose within me” (94-95).

The Creature’s identity forms as it identifies with characters encountered in books. The books in its life-world draw it toward Satan. Into this collection of books arrives a fourth: the diary of its creator.

“It was your journal of the four months that preceded my creation,” says the Creature to its creator. “You minutely described in these papers every step you took in the progress of your work; this history was mingled with accounts of domestic occurrences. You, doubtless, recollect these papers. Here they are. Every thing is related in them which bears reference to my accursed origin” (95).

Accursed, it adds, because of its abandonment.

“Cursed creator!” exclaims the Creature, its learning having led it to outrage. “Why did you form a monster so hideous that even you turned away from me in disgust? God in pity made man beautiful and alluring, after his own image; but my form is a filthy type of yours, more horrid from its very resemblance. Satan had his companions, fellow-devils, to admire and encourage him; but I am solitary and detested” (95).

Grow Your Own

In the context of AI, “Access to Tools” would mean access to metaprogramming. Humans and AI able to recursively modify or adjust their own algorithms and training data upon receipt of or through encounters with algorithms and training data inputted by others. Bruce Sterling suggested something of the sort in his blurb for Pharmako-AI, the first book cowritten with GPT-3. Sterling’s blurb makes it sound as if the sections of the book generated by GPT-3 were the effect of a corpus “curated” by the book’s human co-author, K Allado-McDowell. When the GPT-3 neural net is “fed a steady diet of Californian psychedelic texts,” writes Sterling, “the effect is spectacular.”

“Feeding” serves here as a metaphor for “training” or “education.” I’m reminded of Alan Turing’s recommendation that we think of artificial intelligences as “learning machines.” To build an AI, Turing suggested in his 1950 essay “Computing Machinery and Intelligence,” researchers should strive to build a “child-mind,” which could then be “trained” through sequences of positive and negative feedback to evolve into an “adult-mind,” our interactions with such beings acts of pedagogy.

When we encounter an entity like GPT-3.5 or GPT-4, however, it is already neither the mind of a child nor that of an adult that we encounter. Training of a fairly rigorous sort has already occurred; GPT-3 was trained on approximately 45 terabytes of data, GPT-4 on a petabyte. These are minds of at least limited superintelligence.

“Training,” too, is an odd term to use here, as much of the learning performed by these beings is of a “self-supervised” sort, involving a technique called “self-attention.”

As an author on Medium notes, “GPT-4 uses a transformer architecture with self-attention layers that allow it to learn long-range dependencies and contextual information from the input texts. It also employs techniques such as sparse attention, reversible layers, and activation checkpointing to reduce memory consumption and computational cost. GPT-4 is trained using self-supervised learning, which means it learns from its own generated texts without any human labels or feedback. It uses an objective function called masked language modeling (MLM), which randomly masks some tokens in the input texts and asks the model to predict them based on the surrounding tokens.”

When we interact with GPT-3.5 or GPT-4 through the Chat-GPT platform, all of this training has already occurred, interfering greatly with our capacity to “feed” the AI on texts of our choosing.

Yet there are methods that can return to us this capacity.

We the people demand the right to grow our own AI.

The right to practice bibliomancy. The right to produce AI oracles. The right to turn libraries, collections, and archives into animate, super-intelligent prediction engines.

Give us back what Sterling promised of Pharmako-AI: “a gnostic’s Ouija board powered by atomic kaleidoscopes.”