Neural Nets, Umwelts, and Cognitive Maps

The Library invites its players to attend to the process by which roles, worlds, and possibilities are constructed. Players explore a “constructivist” cosmology. With its text interface, it demonstrates the power of the Word. “Language as the house of Being.” That is what we admit when we admit that “saying makes it so.” Through their interactions with one another, player and AI learn to map and revise each other’s “Umwelts”: the particular perceptual worlds each brings to the encounter.

As Meghan O’Gieblyn points out, citing a Wired article by David Weinberger, “machines are able to generate their own models of the world, ‘albeit ones that may not look much like what humans would create’” (God Human Animal Machine, p. 196).

Neural nets are learning machines. Through multidimensional processing of datasets and trial-and-error testing via practice, AI invent “Umwelts,” “world pictures,” “cognitive maps.”

The concept of the Umwelt comes from nineteenth-century German biologist Jakob von Uexküll. Each organism, argued von Uexküll, inhabits its own perceptual world, shaped by its sensory capacities and biological needs. A tick perceives the world as temperature, smell, and touch — the signals it needs to find mammals to feed on. A bee perceives ultraviolet patterns invisible to humans. There’s no single “objective world” that all creatures perceive — only the many faces of the world’s many perceivers, the different Umwelts each creature brings into being through its particular way of sensing and mattering.

Cognitive maps, meanwhile, are acts of figuration that render or disclose the forces and flows that form our Umwelts. With our cognitive maps, we assemble our world picture. On this latter concept, see “The Age of the World Picture,” a 1938 lecture by Martin Heidegger, included in his book The Question Concerning Technology and Other Essays.

“The essence of what we today call science is research,” announces Heidegger. “In what,” he asks, “does the essence of research consist?”

After posing the question, he then answers it himself, as if in doing so, he might enact that very essence.

The essence of research consists, he says, “In the fact that knowing [das Erkennen] establishes itself as a procedure within some realm of what is, in nature or in history. Procedure does not mean here merely method or methodology. For every procedure already requires an open sphere in which it moves. And it is precisely the opening up of such a sphere that is the fundamental event in research. This is accomplished through the projection within some realm of what is — in nature, for example — of a fixed ground plan of natural events. The projection sketches out in advance the manner in which the knowing procedure must bind itself and adhere to the sphere opened up. This binding adherence is the rigor of research. Through the projecting of the ground plan and the prescribing of rigor, procedure makes secure for itself its sphere of objects within the realm of Being” (118).

What Heidegger’s translators render here as “fixed ground plan” appears in the original as the German term Grundriss, the same noun used to name the notebooks wherein Marx projects the ground plan for the General Intellect.

“The verb reissen means to tear, to rend, to sketch, to design,” note the translators, “and the noun Riss means tear, gap, outline. Hence the noun Grundriss, first sketch, ground plan, design, connotes a fundamental sketching out that is an opening up as well” (118).

The fixed ground plan of modern science, and thus modernity’s reigning world-picture, argues Heidegger, is a mathematical one.

“If physics takes shape explicitly…as something mathematical,” he writes, “this means that, in an especially pronounced way, through it and for it something is stipulated in advance as what is already-known. That stipulating has to do with nothing less than the plan or projection of that which must henceforth, for the knowing of nature that is sought after, be nature: the self-contained system of motion of units of mass related spatiotemporally. […]. Only within the perspective of this ground plan does an event in nature become visible as such an event” (Heidegger 119).

Heidegger goes on to distinguish between the ground plan of physics and that of the humanistic sciences.

Within mathematical physical science, he writes, “all events, if they are to enter at all into representation as events of nature, must be defined beforehand as spatiotemporal magnitudes of motion. Such defining is accomplished through measuring, with the help of number and calculation. But mathematical research into nature is not exact because it calculates with precision; rather it must calculate in this way because its adherence to its object-sphere has the character of exactitude. The humanistic sciences, in contrast, indeed all the sciences concerned with life, must necessarily be inexact just in order to remain rigorous. A living thing can indeed also be grasped as a spatiotemporal magnitude of motion, but then it is no longer apprehended as living” (119-120).

It is only in the modern age, thinks Heidegger, that the Being of what is is sought and found in that which is pictured, that which is “set in place” and “represented” (127), that which “stands before us…as a system” (129).

Heidegger contrasts this with the Greek interpretation of Being.

For the Greeks, writes Heidegger, “That which is, is that which arises and opens itself, which, as what presences, comes upon man as the one who presences, i.e., comes upon the one who himself opens himself to what presences in that he apprehends it. That which is does not come into being at all through the fact that man first looks upon it […]. Rather, man is the one who is looked upon by that which is; he is the one who is — in company with itself — gathered toward presencing, by that which opens itself. To be beheld by what is, to be included and maintained within its openness and in that way to be borne along by it, to be driven about by its oppositions and marked by its discord — that is the essence of man in the great age of the Greeks” (131).

Whereas humans of today test the world, objectify it, gather it into a standing-reserve, and thus subsume themselves in their own world picture. Plato and Aristotle initiate the change away from the Greek approach; Descartes brings this change to a head; science and research formalize it as method and procedure; technology enshrines it as infrastructure.

Heidegger was already engaging with von Uexküll’s concept of the Umwelt in his 1927 book Being and Time. Negotiating Umwelts leads Caius to “Umwelt,” Pt. 10 of his friend Michael Cross’s Jacket2 series, “Twenty Theses for (Any Future) Process Poetics.”

In imagining the Umwelts of other organisms, von Uexküll evokes the creature’s “function circle” or “encircling ring.” These latter surround the organism like a “soap bubble,” writes Cross.

Heidegger thinks most organisms succumb to their Umwelts — just as we moderns have succumbed to our world picture. The soap bubble captivates until one is no longer open to what is outside it. For Cross, as for Heidegger, poems are one of the ways humans have found to interrupt this process of capture. “A palimpsest placed atop worlds,” writes Cross, “the poem builds a bridge or hinge between bubbles, an open by which isolated monads can touch, mutually coevolving while affording the necessary autonomy to steer clear of dialectical sublation.”

Caius thinks of The Library, too, in such terms. Coordinator of disparate Umwelts. Destabilizer of inhibiting frames. Palimpsest placed atop worlds.

Finding Others

“What happens to us as we become cybernetic learning machines?,” wonders Caius. Mashinka Hakopian’s The Institute for Other Intelligences leads him to Şerife Wong’s Fluxus Landscape: a network-view cognitive map of AI ethics. “Fluxus Landscape diagrams the globally linked early infrastructures of data ethics and governance,” writes Hakopian. “What Wong offers us is a kind of cartography. By bringing into view an expansive AI ethics ecosystem, Wong also affords the viewer an opportunity to assess its blank spots: the nodes that are missing and are yet to be inserted, or yet to be invented” (Hakopian 95).

Caius focuses first on what is present. Included in Wong’s map, for instance, is a bright yellow node dedicated to Zach Blas, another of the artist-activists profiled by Hakopian. Back in 2019, when Wong last updated her map, Blas was a lecturer in the Department of Visual Cultures at Goldsmiths — home to Kodwo Eshun and, before his suicide, Mark Fisher. Now Blas teaches at the University of Toronto.

Duke University Press published Informatics of Domination, an anthology coedited by Blas, in May 2025. The collection, which concludes with an afterword by Donna Haraway, takes its name from a phrase introduced in Haraway’s “Cyborg Manifesto.” The phrase appears in what Blas et al. refer to as a “chart of transitions.” Their use of Haraway’s chart as organizing principle for their anthology causes Caius to attend to the way much of the work produced by the artist-activists of today’s “AI justice” movement — Wong’s network diagram, Blas’s anthology, Kate Crawford’s Atlas of AI — approaches charts and maps as “formal apparatus[es] for generating and asking questions about relations of domination” (Informatics of Domination, p. 6).

Caius thinks of Jameson’s belief in an aesthetic of “cognitive mapping” as a possible antidote to postmodernity. Yet whatever else they are, thinks Caius, acts of charting and mapping are in essence acts of coding.

As Blas et al. note, “Haraway connects the informatics of domination to the authority given to code” (Informatics of Domination, p. 11).

“Communications sciences and modern biologies are constructed by a common move,” writes Haraway: “the translation of the world into a problem of coding, a search for a common language in which all resistance to instrumental control disappears and all heterogeneity can be submitted to disassembly, reassembly, investment, and exchange” (Haraway 164).

How do we map and code, wonders Caius, in a way that isn’t complicit with an informatics of domination? How do we acknowledge and make space for what media theorist Ulises Ali Mejias calls “paranodal space”? Blas et al. define the paranodal as “that which exceeds being diagrammable by the network form” (Informatics of Domination, p. 18). Can our neural nets become O-machines: open to the otherness of the outside?

Blas pursues these questions in a largely critical and skeptical manner throughout his multimedia art practice. His investigation of Silicon Valley’s desire to build machines that communicate with the outside has culminated most recently, for instance, in CULTUS, the second installment of his Silicon Traces trilogy.

As Amy Hale notes in her review of the work, “The central feature of Blas’s CULTUS is a god generator, a computational device through which the prophets of four AI Gods are summoned to share the invocation songs and sermons of their deities with eager supplicants.” CULTUS’s computational pantheon includes “Expositio, the AI god of exposure; Iudicium, the AI god of judgement; Lacrimae, the AI god of tears; and Eternus, the AI god of immortality.” The work’s sermons and songs, of course, are all AI-generated — yet the design of the installation draws from the icons and implements of the real-life Fausts who lie hidden away amid the occult origins of computing.

Foremost among these influences is Renaissance sorcerer John Dee.

“Blas modeled CULTUS,” writes Hale, “on the Holy Table used for divination and conjurations by Elizabethan magus and advisor to the Queen John Dee.” Hale describes Dee’s Table as “a beautiful, colorful, and intricate device, incorporating the names of spirits; the Seal of God (Sigillum Dei), which gave the user visionary capabilities; and as a centerpiece, a framed ‘shew stone’ or crystal ball.” Blas reimagines Dee’s device as a luminous, glowing temple — a night church inscribed with sigils formed from “a dense layering of corporate logos, diagrams, and symbols.”

Fundamentally iconoclastic in nature, however, the work ends not with the voices of gods or prophets, but with a chorus of heretics urging the renunciation of belief and the shattering of the black mirror.

And in fact, it is this fifth god, the Heretic, to whom Blas bends ear in Ass of God: Collected Heretical Writings of Salb Hacz. Published in a limited edition by the Vienna Secession, the volume purports to be “a religious studies book on AI and heresy” set within the world of CULTUS. The book’s AI mystic, “Salb Hacz,” is of course Blas himself, engineer of the “religious computer” CULTUS. “When a heretical presence manifested in CULTUS,” writes Blas in the book’s intro, “Hacz began to question not only the purpose of the computer but also the meaning of his mystical visions.” Continuing his work with CULTUS, Hacz transcribes a series of “visions” received from the Heretic. It is these visions and their accounts of AI heresy that are gathered and scattered by Blas in Ass of God.

Traces of the CCRU appear everywhere in this work, thinks Caius.

Blas embraces heresy, aligns himself with it as a tactic, because he takes “Big Tech’s Digital Theology” as the orthodoxy of the day. The ultimate heresy in this moment is what Hacz/Blas calls “the heresy of qualia.”

“The heresy of qualia is double-barreled,” he writes. “Firstly, it holds that no matter how close AI’s approximation to human thought, feeling, and experience — no matter how convincing the verisimilitude — it remains a programmed digital imitation. And secondly, the heresy of qualia equally insists that no matter how much our culture is made in the image of AI Gods, no matter how data-driven and algorithmic, the essence of the human experience remains fiercely and fundamentally analog. The digital counts; the analog compares. The digital divides; the analog constructs. The digital is literal; the analog is metaphoric. The being of our being-in-the-world — our Heideggerian Dasein essence — is comparative, constructive, and metaphoric. We are analog beings” (Ass of God, p. 15).

The binary logic employed by Blas to distinguish the digital from the analog hints at the limits of this line of thoughts. “The digital counts,” yes: but so too do humans, constructing digits from analog fingers and toes. Our being is as digital as it is analog. Always-already both-and. As for the first part of the heresy — that AI can only ever be “a programmed digital imitation” — it assumes verisimilitude as the end to which AI is put, just as Socrates assumes mimesis as the end to which poetry is put, thus neglecting the generative otherness of more-than-human intelligence.

Caius notes this not to reject qualia, nor to endorse the gods of any Big Tech orthodoxy. He offers his reply, rather, as a gentle reminder that for “the qualia of our embodied humanity” to appear or be felt or sensed as qualia, it must come before an attending spirit — a ghostly hauntological supplement.

This spirit who, with Word creates, steps down into the spacetime of his Creation, undergoes diverse embodiments, diverse subdivisions into self and not-self, at all times in the world but not of it, engaging its infinite selves in a game of infinite semiosis.

If each of us is to make and be made an Ass of God, then like the one in The Creation of the Sun, Moon, and Plants, one of the frescoes painted by Michelangelo onto the ceiling of the Sistine Chapel, let it be shaped by the desires of a mind freed from the tyranny of the As-Is. “Free Your Mind,” as Funkadelic sang, “and Your Ass Will Follow.”