Researchers at North Carolina State University studied how safety alignment works in large language models and tested new training techniques to reduce unsafe outputs while keeping model performance. Jung-Eun Kim, the corresponding author and an assistant professor, said they do not want LLMs to tell people to harm themselves or give information that could harm others.
The team identified two main challenges. One is the alignment tax: safety training can reduce a model's accuracy. The other is superficial alignment, where a model treats a request as safe or unsafe early in response generation. Jianwei Li, the first author, gave an example about requests for instructions to steal money and how motives can change the model's reply.
The researchers proposed the Superficial Safety Alignment Hypothesis (SSAH). They searched models for safety-critical neural components and showed that freezing those components during fine-tuning helps preserve original safety behavior while the model learns domain tasks. The work will be presented at ICLR2026 and supporting code is available online.
Difficult words
- safety alignment — methods to make a model behave safely
- alignment tax — loss of model accuracy after safety training
- superficial alignment — early, surface-level safety decisions during reply generation
- fine-tuning — small additional training to adapt a model
- freeze — prevent parts of a model from changingfreezing
- unsafe output — text from a model that could cause harmunsafe outputs
Tip: hover, focus or tap highlighted words in the article to see quick definitions while you read or listen.
Discussion questions
- Do you think it is a good idea to freeze parts of a model during training? Why or why not?
- How could reducing the alignment tax help people who use language models?
- Have you ever seen a model give unsafe advice? What did you do then?
Related articles
Touchscreens on car dashboards increase driver distraction
A simulator study found that using a car touchscreen while driving makes steering and touchscreen tasks worse. Multitasking reduced lane control and touchscreen accuracy; researchers suggest simple sensors could monitor attention and change the interface.
Electric car batteries can power homes and cut costs
A University of Michigan study finds that using electric vehicle batteries to power homes (vehicle-to-home, V2H) can save owners thousands of dollars and reduce greenhouse gas emissions. Results differ across regions and the technology is still being tested.
Small pause to slow misinformation on social media
Researchers at the University of Copenhagen propose a small pause before sharing on platforms like X, Bluesky and Mastodon. A computer model shows that a short delay plus a brief learning step can reduce reshares and improve shared content quality.
Brain predictions use phrases, not just next words
New research shows the human brain anticipates upcoming language by grouping words into grammatical phrases rather than predicting only the next single word. Scientists used brain recordings, behavioral tests and LLM measures across languages.