Ian Flynn of the University of Pittsburgh and Sean Peters of Middlebury College tested Google’s NotebookLM by converting published research papers into podcast-style audio overviews. In their October paper in the American Geophysical Union journal Perspectives of Earth and Space Scientists, they evaluate both the strengths and the limits of these AI-generated summaries.
The researchers transformed three papers about volcanism on Mars into NotebookLM audio. The sources differed in format: a five-page letter with three figures and one table, a 29-page research paper with nine figures and four tables, and a 23-page review with 11 figures. Google describes the overviews as “deep-dive discussions between AI hosts that provide in-depth summaries of the key topics in your uploaded sources,” and the authors found the results engaging and written in plain language.
Flynn and Peters praised the use of fairly accurate and creative analogies, which can help teaching and make technical work more accessible. Yet every overview contained errors, and mistakes tended to appear toward the end of the audio. Some errors involved clear overreach—for example, one overview extrapolated from a volcanic feature to suggest liquid water and the possibility of life, claims not present in the original paper. The authors see useful roles for these overviews in learning and in demonstrating how to interpret research, but they conclude: “Overall, NotebookLM’s generated audio overviews can be a useful tool for the planetary science community, but it is doubtful to be a replacement for critically reading the source material.”
Difficult words
- overview — short summary of a longer text or workaudio overviews, overviews
- extrapolate — infer beyond given information, often by extending ideasextrapolated
- analogy — comparison that shows similarity between different thingsanalogies
- volcanism — processes related to volcanoes and volcanic activity
- overreach — an excessive or unsupported conclusion or claim
- interpret — explain the meaning of information or results
Tip: hover, focus or tap highlighted words in the article to see quick definitions while you read or listen.
Discussion questions
- How could teachers use AI-generated audio overviews in class while avoiding the risk of errors?
- What steps would you take to check claims made in an AI summary of a research paper?
- Do you think audio summaries make scientific research more accessible to the public? Why or why not?
Related articles
AI expands sexual and reproductive health access in Latin America
Research groups in Peru and Argentina use AI tools to give sexual and reproductive health information to young and marginalised people. Experts praise potential but warn of bias and call for better data, rules and oversight.
Band of Holes at Monte Sierpe: an Indigenous accounting system?
New evidence suggests the Band of Holes at Monte Sierpe in southern Peru was part of a pre‑European Indigenous system for accounting and exchange. Researchers used sediment analysis and drone images to reach this conclusion.
Winter break activities that build children’s skills
A Virginia Tech educator says families can use everyday tasks during winter break to build thinking, planning and independence. Simple, hands-on activities like baking, budgeting and observing nature teach practical STEM and life skills without formal homework.
