Statement on Superintelligence taken from https://superintelligence-statement.org/
Context:
Innovative AI tools may bring unprecedented health and prosperity. However, alongside tools, many leading AI companies have the stated goal of building superintelligence in the coming decade that can significantly outperform all humans on essentially all cognitive tasks. This has raised concerns, ranging from human economic obsolescence and disempowerment, losses of freedom, civil liberties, dignity, and control, to national security risks and even potential human extinction. The succinct statement below aims to create common knowledge of the growing number of experts and public figures who oppose a rush to superintelligence.
Statement:
We call for a prohibition on the development of superintelligence, not lifted before there is
- broad scientific consensus that it will be done safely and controllably
- strong public buy-in.
As if this will stop it being made, even if it is put into law. All it will do is make it happen without legal and public oversight.
Do you then think (considering that it is possible) that the development of a super intelligence is inevitable?
Yes, and it will also almost certainly be misaligned with human values.