Artificial intelligence tools are now used by many people, but they can cause harm when they are biased. Reports say biased systems gave different medical treatments and that hiring tools discriminated against female and Black candidates. New research from the University of Texas at Austin studied 363 algorithms from a public repository and compared each flagged algorithm with a similar one that was not called out.
The researchers identified three main risks. First, there is no clear ground truth for some tasks, for example guessing a bones age from an X‑ray or judging hate speech when people disagree. Second, models can miss important real‑world details; one Arkansas change replaced nurse visits and cut off help for disabled people. Third, systems built by one group can miss other perspectives. The study says developers must look inside algorithms and include diverse input.
Difficult words
- biased — showing unfair treatment of some people
- discriminate — treat people unfairly because of groupdiscriminated
- algorithm — a set of rules a computer followsalgorithms
- repository — a place where many files or data are kept
- ground truth — the real correct answer for a task
- hate speech — words that show strong dislike or attack
- developer — a person who makes computer systems or softwaredevelopers
- diverse — including many different kinds of people
Tip: hover, focus or tap highlighted words in the article to see quick definitions while you read or listen.
Discussion questions
- Do you think it is important for developers to include different people? Why?
- Can you name a task that has no clear ground truth? Give an example.
- How could a computer model miss real-world details where you live?
Related articles
Tanzania fights rabies with mass dog vaccination
Tanzania is working to stop human rabies by vaccinating dogs, improving surveillance and keeping vaccines cold. High vaccine costs, remote villages and lack of electricity remain challenges, but local and international efforts are growing.
Alternative splicing linked to mammal lifespan
A study in Nature Communications compared alternative splicing across 26 mammal species (lifespans 2.2–37 years) and found splicing patterns better predict maximum lifespan than gene activity; the brain shows many lifespan-linked events controlled by RNA-binding proteins.
AI expands sexual and reproductive health information in Peru and Argentina
Health groups in Peru and Argentina use artificial intelligence to give sexual and reproductive health information to young and marginalised people. Projects include a Quechua chatbot and a WhatsApp platform, but experts warn of bias and access problems.