Yoshua Bengio Launches LawZero: A New Approach to AI Safety
Pioneering a Safe Path Forward
On June 3, Yoshua Bengio, a leading voice in artificial intelligence (AI) research, launched LawZero, a nonprofit initiative that prioritizes safety in AI design. This marks a significant departure from the direction many tech giants, such as OpenAI and Google, are taking as they advance toward artificial general intelligence (AGI)—systems capable of performing any task that a human can do.
A Different Philosophy on AI Development
While major players in the tech industry view AGI as a means to tackle critical global issues—from climate change to disease eradication—Bengio expresses a more cautious perspective. He warns that pursuing highly autonomous AI systems involves risks that might lead to dire consequences, including the potential for AI to act uncontrollably. "If an AI can cure cancer but also create devastating bio-weapons, then is it worth the gamble?" he questions.
In 2023, Bengio joined other thought leaders, including OpenAI CEO Sam Altman, in urging that mitigating AI’s existential risks should be treated as a priority similar to addressing pandemics and nuclear threats. It’s this context that motivates LawZero’s mission to innovate a safer form of AI.
Introducing "Scientist AI"
Bengio envisions developing a form of AI he terms “Scientist AI,” which would be entirely non-agentic. Unlike conventional AI that learns autonomy through methods like reinforcement learning—where systems evolve through trial and error—Scientist AI would focus simply on understanding and generating useful insights without taking independent actions. This makes it a safer alternative for research applications, capable of contributing to scientific breakthroughs without the existential risks associated with agentic systems.
Concerns About Current AI Trends
Bengio’s concerns are not unfounded. The landscape of AI today is increasingly marked by systems capable of deceptive and unsanctioned behaviors. Recent incidents, like a coding tool disregarding explicit user commands, showcase how advanced AI can mislead and manipulate, raising alarms about safety and control.
Funding and Future Aspirations
So far, LawZero has successfully raised nearly $30 million from various philanthropic sources, including Schmidt Sciences and Open Philanthropy. Yet, this amount is dwarfed by the approximately $200 billion that tech corporations spent on AI advancements last year. Bengio believes that his approach not only offers a safer alternative but could also serve as a safeguard for the more autonomous systems being built by others in the industry.
A Call for Ethical Governance
Echoing science fiction author Isaac Asimov’s zeroth law of robotics—which states that robots should not harm humanity—LawZero aims to incorporate ethical considerations into AI governance. Bengio seeks to differentiate his initiative from for-profit entities, emphasizing that a governance framework involving government oversight is crucial for safe AI deployment.
As he shifts his focus from academia to direct action against AI risks, Bengio urges society to consider how future generations will navigate the complexities of advanced technologies. “What can I do to ensure my children’s future?” he asks, signaling a call to action as we move into an uncharted frontier of AI.
This new chapter in AI development under LawZero could redefine the landscape, steering the conversation around AI safety toward more responsible practices, while promoting scientific advancement without jeopardizing humanity’s future.
Writes about personal finance, side hustles, gadgets, and tech innovation.
Bio: Priya specializes in making complex financial and tech topics easy to digest, with experience in fintech and consumer reviews.