Safe As Podcast

← Safe As Podcast5 dagen geleden · 4 min

E106: Boeing 737 MAX Disaster: When High-Authority Systems Go "Strong, Silent, and Wrong"

E106: Boeing 737 MAX Disaster: When High-Authority Systems Go "Strong, Silent, and Wrong"5 dagen geleden4 min

<p>What happens when a high-authority automated system operate with an incorrect model of reality?This question is explored via Dekker &amp; Woods’ (2024) article on automated systems that are Strong, Silent, and Wrong.We explore the breakdown of human-automation coordination, mode confusion, and automation surprises, using the Boeing 737 MAX MCAS accidents as a central example. Learn how complex system design must prioritize observability, redirectability, and graceful failure.Ref: Dekker, S. W., &amp; Woods, D. D. (2024). Wrong, strong, and silent: What happens when automated systems with high autonomy and high authority misbehave? Journal of Cognitive Engineering and Decision Making, 18(4), 339–347.Resources &amp; Links:Website &amp; Articles: https://safetyinsights.orgSupport the channel: https://buymeacoffee.com/benhutchinson</p>