The advent of Artificial General Intelligence (AGI) has sparked debates and concerns among experts. Demetrius A. Floudas, an AI policy theorist, emphasizes the critical need for security measures and international regulation in the development of AGI.
The Three Epochs of AI
In his analysis, Floudas introduces a novel classification for the AI epoch, divided into three distinct phases. He terms the current era the 'Protonoëtic' stage, where AI models continue to evolve within specific domains. The forthcoming 'Mesonoëtic' period will see the emergence of AGI, possibly leveraging quantum computing. Finally, the 'Kainonoëtic' epoch will be marked by superintelligen ce capable of recursive self-improvement. Floudas warns that "non-biological sentience will constitute the biggest disruptor in mankind’s history," posing unprecedented challenges to humanity.
Among these risks, one of the immediate concerns highlighted by Floudas is cultural annihilation. AI's ability to create art, music, and literature at a superior and faster rate than humans could undermine traditional creative processes. "Who will choose to spend years composing a symphony when an automaton can deliver the same output in minutes?" Floudas questions.
He also discusses the profound impact AGI could have on personal relationships and daily interactions. He envisions a future where individuals seek fulfillment in AI-generated virtual worlds, with virtual partners offering an idealized companionship that real humans cannot match. This scenario evokes the dystopian vision of individuals living in a "permanent digital stupor," disconnected from real human experiences.
Expert Calls for International Control Treaty
To mitigate these risks, Floudas proposes an AGI Control & Non-Proliferation Treaty, similar to the regulation of nuclear weapons. This treaty would prohibit for-profit AGI development and place all research under the oversight of an international agency with extensive inspection powers. "Non-biological brains of higher capability should be treated similarly to existing Weapons of Mass Destruction," he asserts.
You can read the full interview here.
The Three Epochs of AI
In his analysis, Floudas introduces a novel classification for the AI epoch, divided into three distinct phases. He terms the current era the 'Protonoëtic' stage, where AI models continue to evolve within specific domains. The forthcoming 'Mesonoëtic' period will see the emergence of AGI, possibly leveraging quantum computing. Finally, the 'Kainonoëtic' epoch will be marked by superintelligen ce capable of recursive self-improvement. Floudas warns that "non-biological sentience will constitute the biggest disruptor in mankind’s history," posing unprecedented challenges to humanity.
Among these risks, one of the immediate concerns highlighted by Floudas is cultural annihilation. AI's ability to create art, music, and literature at a superior and faster rate than humans could undermine traditional creative processes. "Who will choose to spend years composing a symphony when an automaton can deliver the same output in minutes?" Floudas questions.
He also discusses the profound impact AGI could have on personal relationships and daily interactions. He envisions a future where individuals seek fulfillment in AI-generated virtual worlds, with virtual partners offering an idealized companionship that real humans cannot match. This scenario evokes the dystopian vision of individuals living in a "permanent digital stupor," disconnected from real human experiences.
Expert Calls for International Control Treaty
To mitigate these risks, Floudas proposes an AGI Control & Non-Proliferation Treaty, similar to the regulation of nuclear weapons. This treaty would prohibit for-profit AGI development and place all research under the oversight of an international agency with extensive inspection powers. "Non-biological brains of higher capability should be treated similarly to existing Weapons of Mass Destruction," he asserts.
You can read the full interview here.