Key human rights challenges of AI

The key human rights challenges of artificial intelligence (AI) cover a wide range of concerns and highlight the complex relationship between AI and human rights.

Below is an overview of some of the key challenges posed by AI.

However, it is crucial to recognise that the challenges described here are not exhaustive. AI systems have the potential to affect all human rights, given their indivisible, interdependent and interrelated nature.

Erosion of the right to privacy

The right to a private life is threatened by the constant tracking and surveillance that AI systems use for data collection. The lack of transparency about how AI systems operate creates uncertainty for individuals, whose data can reveal not only their interests but also their vulnerabilities. Consequently, an imbalance of power emerges. Companies possess extensive knowledge about users, while users remain uncertain about how their data is used and whose interests it serves.

Exacerbation of existing discrimination and social inequalities

The right not to be discriminated against is at increased risk because AI systems tend to exacerbate existing social inequalities by targeting already vulnerable groups. Technologies such as facial recognition and language modelling have shown prejudice against racial and ethnic minorities, leading to injustices such as false arrests and accusations. Additionally, the opacity of and interests served by AI systems can perpetuate manipulative practices. Finally, AI systems further marginalise certain groups, such as people who are not digitally literate or people with disabilities.

Challenges to freedom of expression and information

Freedom of expression and information also face challenges. AI-driven moderation on platforms can inadvertently suppress legitimate forms of expression beyond legal requirements on hate speech and other unlawful forms of expression. Indeed, AI systems struggle to understand context and nuance within speech, and the use of bots introduces new possibilities for abuse. Moreover, systems that have algorithms with addictive designs or that create echo chambers, such as some social media platforms, can influence the ability to freely make choices and decisions without coercion or manipulation. Ultimately, this impacts on democratic participation and the free flow of information.

Threats to transparency, accountability and effective remedy

When private sector technology is used, including in the public sphere, questions of accountability and transparency may arise due to the secretive nature of these algorithms. Members of the public often lack insight into the decision-making processes and therefore struggle to challenge outcomes. This hinders their right to be heard and the right to an effective remedy.

Structural harms affecting human dignity

Moreover, in addition to the specific human rights challenges mentioned above, AI has a profound effect on human dignity in general. Structural harms from surveillance technologies erode concepts such as human autonomy, human agency, self-governance and self-determination. At the same time, emotional recognition technologies risk dehumanising individuals by reducing them to data points detached from their inherent worth and dignity.

Collective and societal level harms

The invisible and unpredictable nature of human rights harms from AI systems poses complex challenges. While these harms may not always be observable individually, their cumulative effect can have a significant impact on societies as a whole. It is difficult for individuals to perceive the existence of biased systems, as its impact can only be seen when looking at statistical aggregates and distributions. This highlights the need for human rights considerations throughout the entire lifecycle of AI systems, from design to deployment.

In summary, AI poses many challenges to the human rights framework. Many of these align with concerns already familiar to NHRIs. The complexity lies in the fact that much of the harm caused by AI is not felt directly at the individual level. Instead, it often occurs unnoticed, affecting society at large. Therefore, it is critical for human rights considerations to feature from the outset and throughout the entirety of the lifecycle of AI systems. This can be achieved through initiatives such as adopting a human rights impact assessment to identify, address, and mitigate human rights risks.