The Adolescence of Technology

This is the latest essay by Dario Amodei, the CEO of Anthropic. Anthropic makes the "Claude" line of LLMs.

We encourage you to read it.

Taking time to carefully build AI systems so they do not autonomously threaten humanity is in genuine tension with the need for democratic nations to stay ahead of authoritarian nations and not be subjugated by them. But in turn, the same AI-enabled tools that are necessary to fight autocracies can, if taken too far, be turned inward to create tyranny in our own countries. AI-driven terrorism could kill millions through the misuse of biology, but an overreaction to this risk could lead us down the road to an autocratic surveillance state. The labor and economic concentration effects of AI, in addition to being grave problems in their own right, may force us to face the other problems in an environment of public anger and perhaps even civil unrest, rather than being able to call on the better angels of our nature. Above all, the sheer numberof risks, including unknown ones, and the need to deal with all of them at once, creates an intimidating gauntlet that humanity must run.