• About us
  • Raising the Bar
  • Raising your Game
  • The Extra G - Geopolitical
  • Risk Matters - Roundtables
  • Leadership Team
  • Events
  • Blog
  • Contact
  • Menu

The Risk Coalition

  • About us
  • Raising the Bar
  • Raising your Game
  • The Extra G - Geopolitical
  • Risk Matters - Roundtables
  • Leadership Team
  • Events
  • Blog
  • Contact

Artificial intelligence: the challenges of existential AI

June 27, 2023

Artificial Intelligence (AI) has emerged as a powerful tool that holds immense potential to transform various aspects of our lives. While the development of AI brings forth numerous benefits, it is crucial to recognize and address the existential threats associated with its advancement. It is important to explore the significance of prioritising these threats in AI and the distinction between trustworthy AI and existential AI.

Trustworthy AI refers to the development and deployment of AI systems that are reliable, unbiased, and transparent. It aims to ensure that AI algorithms and models are accountable and can be audited for fairness and ethical considerations. Efforts are being made to define actions and frameworks to mitigate biases, enhance explainability, and establish regulations for responsible AI practices. While these endeavors are crucial, they primarily focus on improving the immediate challenges and shortcomings of AI systems.

While trustworthy AI is a crucial aspect of AI development, existential threats demand even greater attention. Recognising and mitigating the risks associated with AI superintelligence, autonomous weapons, and unforeseen consequences is paramount.

Existential threats in AI refer to potential risks that could have catastrophic consequences for humanity as a whole. Unlike the issues of bias or explainability, existential threats have the potential to alter the course of human existence, posing challenges that are more profound and far-reaching. It is imperative to recognise the gravity of these threats and prioritise research, development, and regulations accordingly.

I was going through a presentation on AI delivered by the Existential Risk Laboratory and came across a fascinating chart that compared various existential risks:

What truly caught my attention was the surprising placement of "Unaligned AI systems" above existential threats such as pandemics, climate change, and nuclear war. This observation left me intrigued and sparked a curiosity about the potential risks associated with unaligned AI systems. The concept of unaligned AI refers to artificial intelligence systems that are not properly aligned with human values, intentions, or goals. It suggests a scenario where AI systems may act in ways that diverge from our desired outcomes or even work against human interests.

The fact that unaligned AI systems were ranked higher than risks as grave as pandemics, climate change, and nuclear war highlights the significance and urgency of addressing AI alignment. It underscores the need for responsible development and governance of AI technologies to ensure that they align with human values and mitigate potential risks.

Understanding and managing the risks associated with AI alignment is a crucial aspect of AI development. It requires a multidisciplinary approach that encompasses research, ethics, and policy frameworks to guide the design and deployment of AI systems. By doing so, we can strive for the safe and beneficial integration of AI while minimizing the potential negative consequences.

As we navigate the advancements in AI, it is essential for researchers, policymakers, and society at large to engage in meaningful discussions and take proactive measures to ensure the responsible development of AI technologies. By fostering collaboration, transparency, and ethical practices, we can work towards aligning AI systems with human values while effectively addressing the associated risks.

Dr Hammou Messatfa is Data and AI IBM Customer Success Manager. He is also a member of the IBM Academy of Technology as well as Professor at Dubai RIT University

Tags: Hammou Messafta
Prev / Next

Blog

Featured
Apr 15, 2025
Vera Cherepanova
The future of ESG: navigating a fragmented landscape
Apr 15, 2025
Vera Cherepanova
Apr 15, 2025
Vera Cherepanova
Mar 6, 2025
Mo Warsame, Gavin Hayes
Internal audit and risk management must work together to navigate uncertainty
Mar 6, 2025
Mo Warsame, Gavin Hayes
Mar 6, 2025
Mo Warsame, Gavin Hayes
Sep 4, 2024
Polly Williams, Mia Harris
Three key threats of phishing to be aware of
Sep 4, 2024
Polly Williams, Mia Harris
Sep 4, 2024
Polly Williams, Mia Harris
Aug 25, 2024
Felix Ritchie
Principles versus rules in data and corporate governance
Aug 25, 2024
Felix Ritchie
Aug 25, 2024
Felix Ritchie
Jul 16, 2024
Jane Hunter, Mia Harris
How can you maintain high standards in your business without suffering burnout?
Jul 16, 2024
Jane Hunter, Mia Harris
Jul 16, 2024
Jane Hunter, Mia Harris
Jun 2, 2024
Afshan Moeed
Enforcement of individual accountability in UK banking: a new boardroom recipe for change or continuity?
Jun 2, 2024
Afshan Moeed
Jun 2, 2024
Afshan Moeed
May 28, 2024
Craig Morris, Mia Harris
Three exciting new developments for AI in 2024 that you need to know about
May 28, 2024
Craig Morris, Mia Harris
May 28, 2024
Craig Morris, Mia Harris
May 24, 2024
Stefan Hunziker
The stuff of nightmares: risk management is shut down, and nobody notices
May 24, 2024
Stefan Hunziker
May 24, 2024
Stefan Hunziker
Mar 20, 2024
Neil Tinegate
What should boards know about digital technology?
Mar 20, 2024
Neil Tinegate
Mar 20, 2024
Neil Tinegate
Mar 15, 2024
Francis Kean
The insolvency risk for company directors - are you swimming naked?
Mar 15, 2024
Francis Kean
Mar 15, 2024
Francis Kean
Feb 29, 2024
Andy Watkins-Child
Are you sitting comfortably?  Cyber risk, board attestations and the implications for NEDs
Feb 29, 2024
Andy Watkins-Child
Feb 29, 2024
Andy Watkins-Child
Oct 24, 2023
Mamun Madaser
Risk management and internal audit should collaborate to navigate the poly-crisis of risk
Oct 24, 2023
Mamun Madaser
Oct 24, 2023
Mamun Madaser
Oct 18, 2023
Jim Watson
How to mitigate the risk of cyber security breaches – part 2
Oct 18, 2023
Jim Watson
Oct 18, 2023
Jim Watson
Oct 13, 2023
Nisha Sanghani
Risk management and internal controls: much (needed) work to do as a result of the proposed changes to the UK Corporate Governance Code
Oct 13, 2023
Nisha Sanghani
Oct 13, 2023
Nisha Sanghani
Oct 9, 2023
Jim Watson
How to mitigate the risk of cyber security breaches – part 1
Oct 9, 2023
Jim Watson
Oct 9, 2023
Jim Watson