Last week, Senator Bernie Sanders announced plans to introduce the Ban Artificial Superintelligence Act, which would prohibit the development of smarter-than-human AI systems and temporarily pause all other advanced AI research until new safety rules can be established. The bill is expected to be introduced in the coming weeks, according to Sanders’ office.
Both the U.S. and U.K. bills additionally seek to compel each government to pursue a global treaty banning the development of superintelligent AI anywhere in the world. “A national bill does not solve the international problem where superintelligence can be developed somewhere else,” says Andrea Miotti, the founder of ControlAI, a campaign group that wrote the U.K. bill and consulted on the U.S. one. “The only way to address that is via international agreements between countries.”
He characterized this grim possibility as a best-case scenario if AI development were to continue without government regulation. “The other possibility is a much larger catastrophe in which humanity loses control irreversibly, and we have no say over whether we continue to exist,” he said. “The third option, that things magically go well, is not realistic.”
The efforts reflect a growing awareness among some lawmakers of what they see as the severe national security risks of AI companies developing superintelligent AI systems, particularly in light of the July disclosure of the Hugging Face incident, in which a swarm of OpenAI agents hacked a separate company without humans telling them to do so, or initially even being aware of their actions.
ControlAI acknowledges these limitations, but says the bills are nevertheless a key step toward government regulation of AI. Superintelligence is “something that no company, no individual, no country knows how to keep under control … most countries don’t want that for very good reason,” says Miotti. “Fundamentally, as has happened in the past with other bills, the first introduction is just the beginning.”
“Things are really crazy over here in San Francisco,” he told lawmakers in London by video. “The core problem is that most of the world just doesn't yet believe that it's really going to happen,” he said, referring to the development of superintelligence.
Kokotajlo, who has an established track record of making accurate predictions about AI progress years in advance, raised the possibility of AI agents taking substantial and covert control of infrastructure at AI companies, and using that foothold to establish a swarm of AIs that could resist human attempts to shut it down.
“It seems like if we had just gotten a little bit less lucky, and the AIs had been a bit smarter, then we still wouldn't know about it [the Hugging Face incident], and there would be this persistent autonomous AI adversary still at large inside OpenAI with the ability to compromise and grow itself further,” he said. “And then, as the next months and years go by, and OpenAI makes more powerful agents, those agents could be brought into the swarm.”
Hence then, the article about the growing push to ban superintelligent ai was published today ( ) and is available on Time ( Middle East ) The editorial team at PressBee has edited and verified it, and it may have been modified, fully republished, or quoted. You can read and follow the updates of this news or article from its original source.
Read More Details
Finally We wish PressBee provided you with enough information of ( The Growing Push to Ban Superintelligent AI )
Also on site :