We Need Smart People Who Give a Shit
We need smart people who give a shit. This truth is always revealed when we learn how complex systems function—or, more often, how they barely function at all. At Stripe, I discovered the fragility and flaws of various banking and money movement systems, which are surprisingly reliable despite their shortcomings. The secret behind this resilience lies in the hands of smart people who possess two crucial qualities: knowledge and care.
These individuals dive deep into understanding complex systems and become invested in their proper functioning, particularly if the systems are vital or critical infrastructure.
This principle applies to numerous other complex systems, from vast infrastructure networks to user-friendly apps. In every case, the functioning of these systems depends on the presence of smart people who give a shit. When such people disappear, the systems are bound to collapse, as evidenced by recent disruptions: Microsoft 365, Air Traffic Control, United Airlines systems, the NSA network, major banks, Apple's systems, and more.
While these failures are not necessarily linked to cyberattacks or generative AI, my experience in dealing with complex systems suggests a common thread behind all disruptions: a shortage of smart people who give a shit.
Capitalism rarely favors those who care deeply about complex systems. However, these individuals are indispensable for building and maintaining the intricate systems that drive capitalist goals. The arrival of generative AI has led management to believe that they can achieve comparable results—or even better performance—using machines.
These machines are cheaper, more efficient, and require no benefits or breaks. Regrettably, though, generative AI is not truly intelligent and does not possess the drive or determination that human experts bring to the table.
Smart people who give a shit notice anomalies, connect dots, and understand how to prevent or rectify issues before they escalate. Generative AI, on the other hand, is merely a collection of data and algorithms designed to produce output based on statistical patterns. It lacks genuine intelligence, care, or concern. Although it can generate plausible results, it falls short when it comes to understanding nuanced situations or handling edge cases.
The collapse of complex systems is partly due to the fact that many smart people who gave a shit have been laid off or forced to focus on managing generative AI instead of their core responsibilities. This shift diminishes their expertise and diminishes their investment in the systems they once knew inside and out. The reliance on generative AI to maintain complex systems is ultimately detrimental to both the systems themselves and the people responsible for their operation.
As we move further away from a world that depends on smart, caring individuals to keep the wheels turning, the risk of system failures increases.
Written by urgent.news from Hacker News's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.