Memo Akten

@memoakten.bsky.social

Ǟʀȶɨֆȶ; Curious philomath; Cofounder superradiance.net; Prof UCSD Making the invisible visceral Cosmosapience·Intelligence·Life·Consciousness·Ecology·Science·Spirituality

The transformer architecture is feed-forward. The only feedback loop in an LLM is via autoregressive inference, and that's a single, discrete, low-bandwidth bottleneck*. If you believe that's enough for an LLM to be 'conscious', then you must also believe either:

The transformer architecture is feed-forward. The only feedback loop in an LLM is via autoregressive inference, and that's a single, discrete, low-bandwidth bottleneck*. 

 **If you believe** that's enough for an LLM to be 'conscious', then you must also believe either:

i) every time you have a conversation with someone - or even read this tweet - you're bringing into being a conscious entity that spans you and the other person,
or

ii) if the attention mechanism is what makes it conscious, then a brand new consciousness flashes into existence and dies with every single token. Forget about the water consumption, you're spawning and annihilating hundreds of consciousnesses just to generate a small paragraph, and millions more for your vibe coded app.

---

(*KV caching is a computational optimization, not an additional information channel. It contains no state that isn't already strictly derived from the low-bandwidth token sequence. H(KV | Tokens)==0. )

As 'Agentic AI' becomes the new buzzword, I fondly remember mid 2010s 'bot' wave. Especially loved bot-band @mpf.bsky.social's Petita Tatata + my Petita DumDum Techa. Every day Tatata generates, recites & posts beautiful abstract poetry & my bot improvises music over it. Every day a new surprise :)

Navier-Stokes equations (that model fluid behavior) are Turing complete. Ie for any given Turing machine (computation) a stationary fluid flow can be constructed such that tracking the trajectory of a particle in the flow encodes the execution of the computation... (1/2) (Vid except from WAVES 2014)

We sail through endless skies Stars shine like eyes The black night sighs … Light of the night The Earth, a purple blaze Of sapphire haze In orbit always … And so, we pass on by … As we travel the universe RIP #OzzyOsbourne Planet Caravan, 1970 Video: Reincarnation, 2009