
← Humans On The Loop: Wisdom for an Age of Magical Technologies11 Mar · 1 h 26 min
(Re)Building Trustworthy Institutions with Nathan Kinch
Today’s very overdue conversation is with AI ethicist and organizational trust expert Nathan Kinch of Trustworthy By Design (Website | LinkedIn), asking questions like: How do institutions made of decent, well-meaning people continue to behave out of alignment with their stated values? How do we dig ourselves out of a catastrophic collapse in trust? How can we design practical, participatory “living labs” for organizational reflection and facilitate convivial, playful environments for working together?
“Certainly one of the world’s leading figures on ethics in practical applications.”— Fionn Delahunty, NLP Lab at University of Galway
As we frequently observe on this show, we need to rework our ideas of agency and identity to adapt them to advances in our understanding of complex systems. Decisions emerge within a nexus of nested, multi-scale dynamics, and our species flourishes or fumbles in intricate symbiotic relationships with the collective intelligences embodied in cultural technologies like states, markets, corporations, and social clubs — beings that, by any reasonable account, live in worlds alien to our own lived experience and demonstrate their own goals and values. Getting them to behave in ways that nourish us requires a much more nuanced theory of change than that which created them in the first place, perhaps even a radically different vision of the links between biology, psychology, society, and environment. And given that AI is a beast of a similar order to these other “egregores” — the entities of collective computation that arise from our efforts to coordinate at scale and then impose their own top-down causal influence on our thoughts and actions — learning how to align individual and organizational purpose can give us profound insight into how to live well alongside (or in the proverbial guts of) newer, more obvious forms of non-human intelligence like LLMs that amplify our biases through lossy compression and feedback, and shape both our desires and view of adjacent possibility.
In other words, the “intent-to-action” gap in corporate ethics and the “paperclip machine” problem in our built wilderness of black box super-machines are structurally identical. And if we can “tame” the secular gods of the modern industrial era , our self-domesticated species may actually still get a chance at living in a zoo of our own choosing.
If you are caught in a system of technologically mediated social dilemmas — and who isn’t? — this will speak to you