Artificial intelligence tools are spreading quickly, and in April ChatGPT reached a billion weekly active users. At the same time, researchers and journalists have documented harms from biased AI, such as unequal medical treatment and hiring tools that discriminate against female and Black candidates. New research from the University of Texas at Austin, led by John‑Patrick Akinyemi and Hüseyin Tanriverdi (a McCombs PhD candidate in IROM), examined 363 algorithms found in the AI Algorithmic and Automation Incidents and Controversies repository.
The team compared each problematic algorithm with a similar algorithm that had not been called out. They examined both the algorithms and the organizations that created and used them. The study highlights three related factors that raise the risk of unfair outcomes: lack of a clear ground truth, simplification of real‑world complexity, and limited stakeholder involvement.
The researchers argue that reducing bias requires more than higher accuracy. Developers should open black boxes, account for complex real conditions, include diverse input, and clarify ground truths. The research appears in MIS Quarterly and is reported by UT Austin.
Difficult words
- algorithm — A set of steps used to solve problems.algorithms
- biased — Showing unfair preference or against some people.
- discriminate — Treat people unfairly because of a group.
- ground truth — A real fact or correct answer in data.ground truths
- stakeholder — A person or group with interest in something.
- repository — A place where information or data is stored.
- black box — A system that hides how it works.black boxes
Tip: hover, focus or tap highlighted words in the article to see quick definitions while you read or listen.
Discussion questions
- Do you think AI tools for hiring or medicine can be unfair? Why or why not?
- How could developers include more diverse people when they build AI systems?
- Would you trust an AI tool that is a 'black box'? Explain your opinion briefly.
Related articles
Africa Launches Satellite Early Warning System for Climate Challenges
Africa is launching a satellite system to improve early warnings for climate events. The program aims to enhance disaster preparedness across the continent.
Territory fights help Ngogo chimpanzees have more babies
Study of Ngogo chimpanzees in Uganda finds that killing neighbouring groups and expanding territory led to more births and much better infant survival in the three years after expansion.
AI and low-cost sensors map air pollution in South Africa
Scientists adapted particle physics methods to build AI_r, a low-cost sensor network that shows air pollution in real time. A pilot in Soweto led to a plan to place 500 sensors across Sedibeng next year.
Inequality and Pandemics: Why Science Alone Is Not Enough
Matthew M. Kavanagh says science can detect viruses and make vaccines fast, but rising inequality makes pandemics worse. He proposes debt relief, shared technology, regional manufacturing and stronger social support to stop future crises.
Science ‘Lost in Translation’ in Africa
The article discusses how language affects scientific understanding in Africa. It highlights the need to translate scientific terms into African languages.
New malaria drug GanLum shows strong trial results
Novartis announced GanLum, a malaria treatment with a new molecule, ganaplacide. In a late-stage trial of over 1,600 patients in 12 sub-Saharan African countries, GanLum cured 97.4% and may be available in 2027.