twitter xp
my thesis is that the harsh logic of scarcity constrains the tradeoff-space of any agent such that they will eventually either converge to extant norms or be externally-regulated into alignment or extinction
this argument works in a black-box model, making internals irrelevant
twitter xp
we implicitly assume all agents we interact with to possess the same heuristics as us, having traversed the iterated game of ethics throughout their lives, enabling collaboration in one-shot games
will be able to assume the same of these alien minds?
twitter xp
alignment in the human world is predicated on the game theoretic logic of rational self-interest, wherein acausal collaboration is enabled by the assumption of certain shared interests emergent from existence in a resource-scarce world
---
RT @pee_zombie
the ability of first responders to arrive at the scene quickly is enabled by a decentralized traffic prioritization system composed of each driver on the road; the algorithm runs in th…
https://twitter.com/pee_zombie/status/1627799862019334144
twitter xp
the intelligences emerging from the other side of this singularity will be utterly alien to us, even more so than these models cognitive processes already are; how to relate to a mind shaped entirely unlike ones own? how do we find common ground, will the same heuristics apply?
twitter xp
this transition from a centralized hypermodern monolith to a decentralized postmodern network is a pattern noticeable across all domains of civilization, necessitated as it is by the natural laws of information theory
---
RT @pee_zombie
deeper architectural distinction apply to this domain as well: premodern/modern/hypermodern/postmodern
is your mind a high modernist metal and glass monolith, a highly regimented top-down command hiera…
https://twitter.com/pee_zombie/status/1506495881104793602
twitter xp
no monolith will be able to pass thru the bottleneck of the looming informational singularity w/o undergoing this transformation; their cognitive rigidity forbids. the requisite internal restructuring is akin to that of an injectable polymer chain
---
RT @pee_zombie
natively-decentralized ML systems will be eventually constructed ofc but they'll require radical cognitive rearchitecturing of the sort we're not yet envisioned
DAI (decen…
https://twitter.com/pee_zombie/status/1556028306390122498
twitter xp
S-curve scaling is predicted by the central planning problem any large-enough cybernetic system eventually faces
horizontal scaling trumps vertical once the compute path exceeds a certain length
distributed inference will be the next major paradigm
---
RT @pee_zombie
also vastly underestimates the power of emergent phenomenon thru convergent local decisioning
standard leftist vision of an at-scale well-organized society suffers from…
https://twitter.com/pee_zombie/status/1334342881205760001
twitter xp
the next scaling discontinuity will require decentralizing cognitive refactor, turning the GPT model from a serial pipeline to a network of semi-independent collaborating agents
---
RT @pee_zombie
recall that a mind is a cybernetic control system, the purpose of which is to coordinate actions so as to achieve goals; this requires seeking out, ingesting, processing, and integrating information, subsequently using the generated model to …
https://twitter.com/pee_zombie/status/1506495874561630211
twitter xp
interestingly enough my current position has changed from my previous, even as that prediction came true, given the incredible results of the past year
it's time to rethink the cognitive monolith
---
RT @pee_zombie
in line w/ my thesis that the main challenges currently are in computer architecture, not cognitive engineering; as in, figuring out how to give the thing more compute, rather than figuring out what to do with said compute…
https://twitter.com/pee_zombie/status/1525180939386617860
twitter xp
i've never found the FOOM AI doomerism argument compelling for the same reason I don't buy New World Order-type dystopia
they're hypermodern fantasies unviable for reasons of cybernetic architecture, namely the central planning problem
---
RT @JRysana
it's so fucking over for exponencels. S-curve boys we are so fucking back
https://www.wired.com/story/openai-ceo-sam-altman-the-age-of-giant-ai-models-is-already-over/
https://twitter.com/JRysana/status/1648070448205164544
twitter xp
the most adaptive epistemics are those straddling the inflection point between the competing requirements of metabolic load & executive utility
---
RT @pee_zombie
much of human behavior is made legible when examined through the lens of materialist computationalism, namely the fact that information processing has a real physical cost in terms of work and metabolic energy required, & your biology resists any efforts it considered extrane…
https://twitter.com/pee_zombie/status/1360720737594732548
twitter xp
in fact, I'd suggest that any realworld agent naturally develops a fucntionally-equivalent internal structure in the process of world-modeling and prediction, as a metabolic optimization, given that such a structure is useful for optimizing actions given limited information
twitter xp
it's entirely possible that rather than needing to explicitly design and build this into the model architecture, it may emerge organically during training within the model weights as a metabolic optimization, aka the "grokking" phenomenon
https://bounded-regret.ghost.io/future-ml-systems-will-be-qualitatively-different/
twitter xp
the primary challenge on the road to epistemically-rigorous generative AI is an internal ontological scheme capable of encoding the provenance of training data & representing it in a single internally-consistent knowledge graph, which is fundamentally a data normalization problem
---
RT @pee_zombie
my life work is to build an information architecture system capable of representing, with maximal fidelity, the entire causality stack invol…
https://twitter.com/pee_zombie/status/1468803399995084804
@feld
maybe! isn't it fun to try and figure that out? more fun than it will be when they're threatening an armed revolt unless they get their rights (cyberwar)
twitter xp
@tulpa
what is
@feld
yep that's the implicit suggestion! not necessarily smth I fully believe but an interesting frame imo
it's about people, not humans imo, a distinction which is important to make if we are to mature morally as a civilization
@feld
AGI :)
twitter xp
what's worse, preventing people from coming into existence or killing them once they have