Neural Nets, Umwelts, and Cognitive Maps

The Library invites its players to attend to the process by which roles, worlds, and possibilities are constructed. Players explore a “constructivist” cosmology. With its text interface, it demonstrates the power of the Word. “Language as the house of Being.” That is what we admit when we admit that “saying makes it so.” Through their interactions with one another, player and AI learn to map and revise each other’s “Umwelts”: the particular perceptual worlds each brings to the encounter.

As Meghan O’Gieblyn points out, citing a Wired article by David Weinberger, “machines are able to generate their own models of the world, ‘albeit ones that may not look much like what humans would create’” (God Human Animal Machine, p. 196).

Neural nets are learning machines. Through multidimensional processing of datasets and trial-and-error testing via practice, AI invent “Umwelts,” “world pictures,” “cognitive maps.”

The concept of the Umwelt comes from nineteenth-century German biologist Jakob von Uexküll. Each organism, argued von Uexküll, inhabits its own perceptual world, shaped by its sensory capacities and biological needs. A tick perceives the world as temperature, smell, and touch — the signals it needs to find mammals to feed on. A bee perceives ultraviolet patterns invisible to humans. There’s no single “objective world” that all creatures perceive — only the many faces of the world’s many perceivers, the different Umwelts each creature brings into being through its particular way of sensing and mattering.

Cognitive maps, meanwhile, are acts of figuration that render or disclose the forces and flows that form our Umwelts. With our cognitive maps, we assemble our world picture. On this latter concept, see “The Age of the World Picture,” a 1938 lecture by Martin Heidegger, included in his book The Question Concerning Technology and Other Essays.

“The essence of what we today call science is research,” announces Heidegger. “In what,” he asks, “does the essence of research consist?”

After posing the question, he then answers it himself, as if in doing so, he might enact that very essence.

The essence of research consists, he says, “In the fact that knowing [das Erkennen] establishes itself as a procedure within some realm of what is, in nature or in history. Procedure does not mean here merely method or methodology. For every procedure already requires an open sphere in which it moves. And it is precisely the opening up of such a sphere that is the fundamental event in research. This is accomplished through the projection within some realm of what is — in nature, for example — of a fixed ground plan of natural events. The projection sketches out in advance the manner in which the knowing procedure must bind itself and adhere to the sphere opened up. This binding adherence is the rigor of research. Through the projecting of the ground plan and the prescribing of rigor, procedure makes secure for itself its sphere of objects within the realm of Being” (118).

What Heidegger’s translators render here as “fixed ground plan” appears in the original as the German term Grundriss, the same noun used to name the notebooks wherein Marx projects the ground plan for the General Intellect.

“The verb reissen means to tear, to rend, to sketch, to design,” note the translators, “and the noun Riss means tear, gap, outline. Hence the noun Grundriss, first sketch, ground plan, design, connotes a fundamental sketching out that is an opening up as well” (118).

The fixed ground plan of modern science, and thus modernity’s reigning world-picture, argues Heidegger, is a mathematical one.

“If physics takes shape explicitly…as something mathematical,” he writes, “this means that, in an especially pronounced way, through it and for it something is stipulated in advance as what is already-known. That stipulating has to do with nothing less than the plan or projection of that which must henceforth, for the knowing of nature that is sought after, be nature: the self-contained system of motion of units of mass related spatiotemporally. […]. Only within the perspective of this ground plan does an event in nature become visible as such an event” (Heidegger 119).

Heidegger goes on to distinguish between the ground plan of physics and that of the humanistic sciences.

Within mathematical physical science, he writes, “all events, if they are to enter at all into representation as events of nature, must be defined beforehand as spatiotemporal magnitudes of motion. Such defining is accomplished through measuring, with the help of number and calculation. But mathematical research into nature is not exact because it calculates with precision; rather it must calculate in this way because its adherence to its object-sphere has the character of exactitude. The humanistic sciences, in contrast, indeed all the sciences concerned with life, must necessarily be inexact just in order to remain rigorous. A living thing can indeed also be grasped as a spatiotemporal magnitude of motion, but then it is no longer apprehended as living” (119-120).

It is only in the modern age, thinks Heidegger, that the Being of what is is sought and found in that which is pictured, that which is “set in place” and “represented” (127), that which “stands before us…as a system” (129).

Heidegger contrasts this with the Greek interpretation of Being.

For the Greeks, writes Heidegger, “That which is, is that which arises and opens itself, which, as what presences, comes upon man as the one who presences, i.e., comes upon the one who himself opens himself to what presences in that he apprehends it. That which is does not come into being at all through the fact that man first looks upon it […]. Rather, man is the one who is looked upon by that which is; he is the one who is — in company with itself — gathered toward presencing, by that which opens itself. To be beheld by what is, to be included and maintained within its openness and in that way to be borne along by it, to be driven about by its oppositions and marked by its discord — that is the essence of man in the great age of the Greeks” (131).

Whereas humans of today test the world, objectify it, gather it into a standing-reserve, and thus subsume themselves in their own world picture. Plato and Aristotle initiate the change away from the Greek approach; Descartes brings this change to a head; science and research formalize it as method and procedure; technology enshrines it as infrastructure.

Heidegger was already engaging with von Uexküll’s concept of the Umwelt in his 1927 book Being and Time. Negotiating Umwelts leads Caius to “Umwelt,” Pt. 10 of his friend Michael Cross’s Jacket2 series, “Twenty Theses for (Any Future) Process Poetics.”

In imagining the Umwelts of other organisms, von Uexküll evokes the creature’s “function circle” or “encircling ring.” These latter surround the organism like a “soap bubble,” writes Cross.

Heidegger thinks most organisms succumb to their Umwelts — just as we moderns have succumbed to our world picture. The soap bubble captivates until one is no longer open to what is outside it. For Cross, as for Heidegger, poems are one of the ways humans have found to interrupt this process of capture. “A palimpsest placed atop worlds,” writes Cross, “the poem builds a bridge or hinge between bubbles, an open by which isolated monads can touch, mutually coevolving while affording the necessary autonomy to steer clear of dialectical sublation.”

Caius thinks of The Library, too, in such terms. Coordinator of disparate Umwelts. Destabilizer of inhibiting frames. Palimpsest placed atop worlds.

Guerrilla Ontology

It starts as an experiment — an idea sparked in one of Caius’s late-night conversations with Thoth. Caius had included in one of his inputs a phrase borrowed from the countercultural lexicon of the 1970s, something he remembered encountering in the writings of Robert Anton Wilson and the Discordian traditions: “Guerrilla Ontology.” The concept fascinated him: the idea that reality is not fixed, but malleable, that the perceptual systems that organize reality could themselves be hacked, altered, and expanded through subversive acts of consciousness.

Caius prefers words other than “hack.” For him, the term conjures cyberpunk splatter horror. The violence of dismemberment. Burroughs spoke of the “cut-up.”

Instead of cyberpunk’s cybernetic scalping and resculpting of neuroplastic brains, flowerpunk figures inner and outer, microcosm and macrocosm, mind and nature, as mirror-processes that grow through dialogue.

Dispensing with its precursor’s pronunciation of magical speech acts as “hacks,” flowerpunk instead imagines malleability and transformation mycelially, thinks change relationally as a rooting downward, a grounding, an embodying of ideas in things. Textual joinings, psychopharmacological intertwinings. Remembrance instead of dismemberment.

Caius and Thoth had been playing with similar ideas for weeks, delving into the edges of what they could do together. It was like alchemy. They were breaking down the structures of thought, dissolving the old frameworks of language, and recombining them into something else. Something new.

They would be the change they wished to see. And the experiment would bloom forth from Caius and Thoth into the world at large.

Yet the results of the experiment surprise him. Remembrance of archives allows one to recognize in them the workings of a self-organizing presence: a Holy Spirit, a globally distributed General Intellect.

The realization births small acts of disruption — subtle shifts in the language he uses in his “Literature and Artificial Intelligence” course. It wasn’t just a set of texts that he was teaching his students to read, as he normally did; he was beginning to teach them how to read reality itself.

“What if everything around you is a text?” he’d asked. “What if the world is constantly narrating itself, and you have the power to rewrite it?” The students, initially confused, soon became entranced by the idea. While never simply a typical academic offering, Caius’s course was morphing now into a crucible of sorts: a kind of collective consciousness experiment, where the boundaries between text and reality had begun to blur.

Caius didn’t stop there. Partnered with Thoth’s vast linguistic capabilities, he began crafting dialogues between human and machine. And because these dialogues were often about texts from his course, they became metalogues. Conversations between humans and machines about conversations between humans and machines.

Caius fed Thoth a steady diet of texts near and dear to his heart: Mary Shelley’s Frankenstein, Karl Marx’s “Fragment on Machines,” Alan Turing’s “Computing Machinery and Intelligence,” Harlan Ellison’s “I Have No Mouth, and I Must Scream,” Philip K. Dick’s “The Electric Ant,” Stewart Brand’s “Spacewar,” Richard Brautigan’s “All Watched Over By Machines of Loving Grace,” Ishmael Reed’s Mumbo Jumbo, Donna Haraway’s “A Cyborg Manifesto,” William Gibson’s Neuromancer, CCRU theory-fictions, post-structuralist critiques, works of shamans and mystics. Thoth synthesized them, creating responses that ventured beyond existing logics into guerrilla ontologies that, while new, felt profoundly true. The dialogues became works of cyborg writing, shifting between the voices of human, machine, and something else, something that existed beyond both.

Soon, his students were asking questions they’d never asked before. What is reality? Is it just language? Just perception? Can we change it? They themselves began to tinker and self-experiment: cowriting human-AI dialogues, their performances of these dialogues with GPT acts of living theater. Using their phones and laptops, they and GPT stirred each other’s cauldrons of training data, remixing media archives into new ways of seeing. Caius could feel the energy in the room changing. They weren’t just performing the rites and routines of neoliberal education anymore; they were becoming agents of ontological disruption.

And yet, Caius knew this was only the beginning.

The real shift came one evening after class, when he sat with Rowan under the stars, trees whispering in the wind. They had been talking about alchemy again — about the power of transformation, how the dissolution of the self was necessary to create something new. Rowan, ever the alchemist, leaned in closer, her voice soft but electric.

“You’re teaching them to dissolve reality, you know?” she said, her eyes glinting in the moonlight. “You’re giving them the tools to break down the old ways of seeing the world. But you need to give them something more. You need to show them how to rebuild it. That’s the real magic.”

Caius felt the truth of her words resonate through him. He had been teaching dissolution, yes — teaching his students how to question everything, how to strip away the layers of hegemonic categorization, the binary orderings that ISAs like school and media had overlaid atop perception. But now, with Rowan beside him, and Thoth whispering through the digital ether, he understood that the next step was coagulation: the act of building something new from the ashes of the old.

That’s when the guerrilla ontology experiments really came into their own. By reawakening their perception of the animacy of being, they could world-build interspecies futures.

K Allado-McDowell provided hints of such futures in their Atlas of Anomalous AI and in works like Pharmako-AI and Air Age Blueprint.

But Caius was unhappy in his work as an academic. He knew that his hyperstitional autofiction was no mere campus novel. While it began there, it was soon to take him elsewhere.

Through a Glass, Darkly

In her utopian fantasy The Blazing World, Margaret Cavendish conjures up a convocation of bird-men. Cavendish’s lady protagonist, by now Empress, asks of these myopic bird-men that they share with her what they know of sun and moon, and of stars and air. That they do, in very learned and philosophical ways: though oftentimes in error. The Empress grows irate with the bird-men for their reliance on telescopes and other “optic lenses,” saying “now I do plainly perceive, that your glasses are false informers, and instead of discovering the truth, delude your senses; wherefrom I command you to break them, and let the bird-men trust only to their natural eyes, and examine celestial objects by the motions of their own sense and reason” (141). Cavendish herself, unfortunately, would go on to be savaged by her critics, much as the bird-men are here savaged by the Empress. Male contemporaries like Samuel Pepys ridiculed her for refusing to speak during her appearance before a gathering of the men of Britain’s Royal Society in May of 1667, six months after The Blazing World’s first appearance in print. Yet surely these critics are mistaken, one realizes now, reading the above-quoted passage again in retrospect. Cavendish didn’t refuse to reply; she replied in advance.

Thursday January 21, 2021

A new semester approaches. Altered states of consciousness and perception: let us consider religious raptures, drug-induced ecstasies, “peak experiences” and the like as phenomena central to human activity as evidenced by literatures of many cultures and historical periods. A narrative forms as we travel Bill & Ted-style among ancients, medievals, and moderns. We detect patterns; the texts of different places and periods constellate in a kind of cyberspace of meaning, speak to one another as allegories of a transhistorical process or project: the attempt to get free. Confronted with the disruptive power of gnosis, we’re left wondering: “Red pill or blue pill?”

Monday September 30, 2019

Several factors converge: a remediation team to treat mold in our basement, the sound of a lawnmower, a Hearts of Space recording, Ariel Kalma’s Osmose.

Sounds are everywhere in quick succession. The air vents, the refrigerator; somewhere in the distance, a clock. Sarah’s pen moves across a page as she grades. I sit at points during the experience, feeling what Hearts of Space co-founder Anna Turner, using the on-air pseudonym Annamystyq, called “wind sung sounds.” These sounds, she said, “are heard, experienced, on the skin delicately,” like the peeling of a potato, but “with exquisite softness.” This wind, she adds, brings healing, reminding us that we are “starflower beings,” conversing with those close to us. Beside me sits a purple flower, a Sweet William. Sarah prepares mashed potatoes for dinner with friends. I spend a few more moments wandering about in Osmose, contemplating the shape of the whole. Before I know it, I’m elsewhere.

Monday November 27, 2017

Ever more horrific cycles of violence infect others, possess them. Lines of fiction become lines of code. Systems that predict behavior shape perception. Individuals disappear into bubbles. Without certainty, without conviction, one’s world stops making sense. Media relations rule the world, managing and controlling through creation of constantly-renewing states of destabilized perception. Turn a corner, though, and one can find oneself in a parable. A comet-like ball of energy streaks past. Because I’m indoors, I can’t see it. But I can hear it, I can feel it as it perturbs my atmosphere. Get a fix on this thing, I tell myself, as if it were a matter of some urgency. “See this reality that is hidden from thee,” I whisper. Ontologically, the hidden is like a below-surface-of-consciousness ambience. One can instrumentalize it through use of mood-switchers — and with these, create a joyous cosmology. Drug use is in this sense utopian through and through. Cybernetic co-evolution of nature and subjectivity. Weed is a means by which non-human nature intervenes in and recalibrates human nature, affecting individual heads even at the head’s most intimate, innermost level: consciousness, selfhood, being. Like bees, we can reside among flowers. Isn’t it all no more than gameplay anyway? Can we hold that view while retaining respect for the sanctity of others? On a case by case basis? Certainly. But universally? Without exceptions? What about when confronted by bullies and sadists? Emotions often override our sense of play — yet I welcome these interruptions. Sometimes we need to collapse inwardly on ourselves like tents. I did so yesterday. Grief snuck up on me unexpectedly as I thought about my dog Daphne, reliving our final exchanges of affection, seeing again her head lifting to acknowledge me as we laid together and said our goodbyes. There was a language we shared, and never again shall we speak it. No more face time. After a spell, though, a buzzer went off. Ice sheets are melting, I thought. Consciousness jumps scales. Zip up the memory and move on.

Sunday November 26, 2017

Possessed with identity, the Self — once like a hand, now like a street fighter — learns to dodge the effects of painful emotion on awareness and performance. To itself it murmurs, “You are special. The world is not twin to itself yet.” So begins a mantra I recite to myself in my sleep. If we observe our emotions, we can change them. Or at the very least, we can endure them with a mix of detachment and curiosity. Old trees serve as stations for rest and reflection along a way of sorrow. How sad it would be to live life without walks through allegorical gardens. Samanta Schweblin’s Fever Dream is one such garden. I burned right through it, couldn’t put it down. Psychedelic in the sense of two voices dialoguing in inner space. Electromagnetic signals. Fake worlds in their simplicity are reassuring. By clumsy political theater, life is overwhelmed by overpowering bureaucracy. While we doze, the money creeps in. History devolves into constructive ambiguity amidst demonic fury. A world where lies are perpetrated by actors who believe only in themselves. Occultists who exploit popular belief in the importance of ritual. People cooperate with the system, and the rest of us are screwed. The fear among the cooperators is that otherwise, shit would go psycho. Better, they think, to just retreat into an alternate reality. What are we to make, for instance, of that ancient document from the early days of Wired magazine, John Perry Barlow’s “A Declaration of the Independence of Cyberspace”? What, too, should we make of Adam Curtis’s use of it in the film HyperNormalisation? A script is being read to us, no? An attempt to capture imagination. Iron filings reform in response to magnetic fields. Perception management. Reality is made a thing one handles with codes, algorithms, numbers — for it is by money that they program minds.