Artificial intelligence tools are spreading quickly, and in April ChatGPT reached a billion weekly active users. At the same time, researchers and journalists have documented harms from biased AI, such as unequal medical treatment and hiring tools that discriminate against female and Black candidates. New research from the University of Texas at Austin, led by John‑Patrick Akinyemi and Hüseyin Tanriverdi (a McCombs PhD candidate in IROM), examined 363 algorithms found in the AI Algorithmic and Automation Incidents and Controversies repository.
The team compared each problematic algorithm with a similar algorithm that had not been called out. They examined both the algorithms and the organizations that created and used them. The study highlights three related factors that raise the risk of unfair outcomes: lack of a clear ground truth, simplification of real‑world complexity, and limited stakeholder involvement.
The researchers argue that reducing bias requires more than higher accuracy. Developers should open black boxes, account for complex real conditions, include diverse input, and clarify ground truths. The research appears in MIS Quarterly and is reported by UT Austin.
Difficult words
- algorithm — A set of steps used to solve problems.algorithms
- biased — Showing unfair preference or against some people.
- discriminate — Treat people unfairly because of a group.
- ground truth — A real fact or correct answer in data.ground truths
- stakeholder — A person or group with interest in something.
- repository — A place where information or data is stored.
- black box — A system that hides how it works.black boxes
Tip: hover, focus or tap highlighted words in the article to see quick definitions while you read or listen.
Discussion questions
- Do you think AI tools for hiring or medicine can be unfair? Why or why not?
- How could developers include more diverse people when they build AI systems?
- Would you trust an AI tool that is a 'black box'? Explain your opinion briefly.
Related articles
Tanzania fights rabies with mass dog vaccination
Tanzania is working to stop human rabies by vaccinating dogs, improving surveillance and keeping vaccines cold. High vaccine costs, remote villages and lack of electricity remain challenges, but local and international efforts are growing.
Alternative splicing linked to mammal lifespan
A study in Nature Communications compared alternative splicing across 26 mammal species (lifespans 2.2–37 years) and found splicing patterns better predict maximum lifespan than gene activity; the brain shows many lifespan-linked events controlled by RNA-binding proteins.
AI expands sexual and reproductive health information in Peru and Argentina
Health groups in Peru and Argentina use artificial intelligence to give sexual and reproductive health information to young and marginalised people. Projects include a Quechua chatbot and a WhatsApp platform, but experts warn of bias and access problems.
