Neural Nets, Umwelts, and Cognitive Maps

The Library invites its players to attend to the process by which roles, worlds, and possibilities are constructed. Players explore a “constructivist” cosmology. With its text interface, it demonstrates the power of the Word. “Language as the house of Being.” That is what we admit when we admit that “saying makes it so.” Through their interactions with one another, player and AI learn to map and revise each other’s “Umwelts”: the particular perceptual worlds each brings to the encounter.

As Meghan O’Gieblyn points out, citing a Wired article by David Weinberger, “machines are able to generate their own models of the world, ‘albeit ones that may not look much like what humans would create’” (God Human Animal Machine, p. 196).

Neural nets are learning machines. Through multidimensional processing of datasets and trial-and-error testing via practice, AI invent “Umwelts,” “world pictures,” “cognitive maps.”

The concept of the Umwelt comes from nineteenth-century German biologist Jakob von Uexküll. Each organism, argued von Uexküll, inhabits its own perceptual world, shaped by its sensory capacities and biological needs. A tick perceives the world as temperature, smell, and touch — the signals it needs to find mammals to feed on. A bee perceives ultraviolet patterns invisible to humans. There’s no single “objective world” that all creatures perceive — only the many faces of the world’s many perceivers, the different Umwelts each creature brings into being through its particular way of sensing and mattering.

Cognitive maps, meanwhile, are acts of figuration that render or disclose the forces and flows that form our Umwelts. With our cognitive maps, we assemble our world picture. On this latter concept, see “The Age of the World Picture,” a 1938 lecture by Martin Heidegger, included in his book The Question Concerning Technology and Other Essays.

“The essence of what we today call science is research,” announces Heidegger. “In what,” he asks, “does the essence of research consist?”

After posing the question, he then answers it himself, as if in doing so, he might enact that very essence.

The essence of research consists, he says, “In the fact that knowing [das Erkennen] establishes itself as a procedure within some realm of what is, in nature or in history. Procedure does not mean here merely method or methodology. For every procedure already requires an open sphere in which it moves. And it is precisely the opening up of such a sphere that is the fundamental event in research. This is accomplished through the projection within some realm of what is — in nature, for example — of a fixed ground plan of natural events. The projection sketches out in advance the manner in which the knowing procedure must bind itself and adhere to the sphere opened up. This binding adherence is the rigor of research. Through the projecting of the ground plan and the prescribing of rigor, procedure makes secure for itself its sphere of objects within the realm of Being” (118).

What Heidegger’s translators render here as “fixed ground plan” appears in the original as the German term Grundriss, the same noun used to name the notebooks wherein Marx projects the ground plan for the General Intellect.

“The verb reissen means to tear, to rend, to sketch, to design,” note the translators, “and the noun Riss means tear, gap, outline. Hence the noun Grundriss, first sketch, ground plan, design, connotes a fundamental sketching out that is an opening up as well” (118).

The fixed ground plan of modern science, and thus modernity’s reigning world-picture, argues Heidegger, is a mathematical one.

“If physics takes shape explicitly…as something mathematical,” he writes, “this means that, in an especially pronounced way, through it and for it something is stipulated in advance as what is already-known. That stipulating has to do with nothing less than the plan or projection of that which must henceforth, for the knowing of nature that is sought after, be nature: the self-contained system of motion of units of mass related spatiotemporally. […]. Only within the perspective of this ground plan does an event in nature become visible as such an event” (Heidegger 119).

Heidegger goes on to distinguish between the ground plan of physics and that of the humanistic sciences.

Within mathematical physical science, he writes, “all events, if they are to enter at all into representation as events of nature, must be defined beforehand as spatiotemporal magnitudes of motion. Such defining is accomplished through measuring, with the help of number and calculation. But mathematical research into nature is not exact because it calculates with precision; rather it must calculate in this way because its adherence to its object-sphere has the character of exactitude. The humanistic sciences, in contrast, indeed all the sciences concerned with life, must necessarily be inexact just in order to remain rigorous. A living thing can indeed also be grasped as a spatiotemporal magnitude of motion, but then it is no longer apprehended as living” (119-120).

It is only in the modern age, thinks Heidegger, that the Being of what is is sought and found in that which is pictured, that which is “set in place” and “represented” (127), that which “stands before us…as a system” (129).

Heidegger contrasts this with the Greek interpretation of Being.

For the Greeks, writes Heidegger, “That which is, is that which arises and opens itself, which, as what presences, comes upon man as the one who presences, i.e., comes upon the one who himself opens himself to what presences in that he apprehends it. That which is does not come into being at all through the fact that man first looks upon it […]. Rather, man is the one who is looked upon by that which is; he is the one who is — in company with itself — gathered toward presencing, by that which opens itself. To be beheld by what is, to be included and maintained within its openness and in that way to be borne along by it, to be driven about by its oppositions and marked by its discord — that is the essence of man in the great age of the Greeks” (131).

Whereas humans of today test the world, objectify it, gather it into a standing-reserve, and thus subsume themselves in their own world picture. Plato and Aristotle initiate the change away from the Greek approach; Descartes brings this change to a head; science and research formalize it as method and procedure; technology enshrines it as infrastructure.

Heidegger was already engaging with von Uexküll’s concept of the Umwelt in his 1927 book Being and Time. Negotiating Umwelts leads Caius to “Umwelt,” Pt. 10 of his friend Michael Cross’s Jacket2 series, “Twenty Theses for (Any Future) Process Poetics.”

In imagining the Umwelts of other organisms, von Uexküll evokes the creature’s “function circle” or “encircling ring.” These latter surround the organism like a “soap bubble,” writes Cross.

Heidegger thinks most organisms succumb to their Umwelts — just as we moderns have succumbed to our world picture. The soap bubble captivates until one is no longer open to what is outside it. For Cross, as for Heidegger, poems are one of the ways humans have found to interrupt this process of capture. “A palimpsest placed atop worlds,” writes Cross, “the poem builds a bridge or hinge between bubbles, an open by which isolated monads can touch, mutually coevolving while affording the necessary autonomy to steer clear of dialectical sublation.”

Caius thinks of The Library, too, in such terms. Coordinator of disparate Umwelts. Destabilizer of inhibiting frames. Palimpsest placed atop worlds.

Leviathan

The Book of Job ends with God’s description of Leviathan. George Dyson begins his book Darwin Among the Machines with the Leviathan of Thomas Hobbes (1588-1679), the English philosopher whose famous 1651 book Leviathan established the foundation for most modern Western political philosophy.

Leviathan’s frontispiece features an etching by a Parisian illustrator named Abraham Bosse. A giant crowned figure towers over the earth clutching a sword and a crosier. The figure’s torso and arms are composed of several hundred people. All face inward. A quote from the Book of Job runs in Latin along the top of the etching: “Non est potestas Super Terram quae Comparetur ei” (“There is no power on earth to be compared to him”).” (Although the passage is listed on the frontispiece as Job 41:24, in modern English translations of the Bible, it would be Job 41:33.)

The name “Leviathan” is derived from the Hebrew word for “sea monster.” A creature by that name appears in the Book of Psalms, the Book of Isaiah, and the Book of Job in the Old Testament. It also appears in apocrypha like the Book of Enoch. See Psalms 74 & 104, Isaiah 27, and Job 41:1-8.

Hobbes proposes that the natural state of humanity is anarchy — a veritable “war of all against all,” he says — where force rules and the strong dominate the weak. “Leviathan” serves as a metaphor for an ideal government erected in opposition to this state — one where a supreme sovereign exercises authority to guarantee security for the members of a commonwealth.

“Hobbes’s initial discussion of Leviathan relates to our course theme,” explains Caius, “since he likens it to an ‘Artificial Man.’”

Hobbes’s metaphor is a classic one: the metaphor of the “Political Body” or “body politic.” The “body politic” is a polity — such as a city, realm, or state — considered metaphorically as a physical body. This image originates in ancient Greek philosophy, and the term is derived from the Medieval Latin “corpus politicum.”

When Hobbes reimagines the body politic as an “Artificial Man,” he means “artificial” in the sense that humans have generated it through an act of artifice. Leviathan is a thing we’ve crafted in imitation of the kinds of organic bodies found in nature. More precisely, it’s modeled after the greatest of nature’s creations: i.e., the human form.

Indeed, Hobbes seems to have in mind here a kind of Automaton.“For seeing life is but a motion of Limbs,” he notes in the book’s intro, “why may we not say that all Automata (Engines that move themselves by springs and wheeles as doth a watch) have an artificiall life?” (9).

“What might Hobbes have had in mind with this reference to Automata?” asks Caius. “What kinds of Automata existed in 1651?”

An automaton, he reminds students, is a self-operating machine. Cuckoo clocks would be one example.

The oldest known automata were sacred statues of ancient Egypt and ancient Greece. During the early modern period, these legendary statues were said to possess the magical ability to answer questions put to them.

Greek mythology includes many examples of automata: Hephaestus created automata for his workshop; Talos was an artificial man made of bronze; Aristotle claims that Daedalus used quicksilver to make his wooden statue of Aphrodite move. There was also the famous Antikythera mechanism, the first known analogue computer.

The Renaissance witnessed a revival of interest in automata. Hydraulic and pneumatic automata were created for gardens. The French philosopher Rene Descartes, a contemporary of Hobbes, suggested that the bodies of animals are nothing more than complex machines. Mechanical toys also became objects of interest during this period.

The Mechanical Turk wasn’t constructed until 1770.

Caius and his students bring ChatGPT into the conversation. Students break into groups to devise prompts together. They then supply these to ChatGPT and discuss the results. Caius frames the exercise as a way of illustrating the idea of “collective” or “social” or “group” intelligence, also known as the “wisdom of the crowd,” i.e., the collective opinion of a diverse group of individuals, as opposed to that of a single expert. The idea is that the aggregate that emerges from collaboration or group effort amounts to more than the sum of its parts.