#research

Research

936 stories tagged Research · page 35 of 39

Researchers Map 'Bias Fingerprints' in GPT-2 and Llama 3.2
research

Researchers Map 'Bias Fingerprints' in GPT-2 and Llama 3.2

A new study identifies specific neurons and attention heads in LLMs that encode harmful stereotypes. The research provides tools to locate and potentially mitigate biases in AI models. Researchers used a combination of contrastive neuron activation analysis and attention head tracking to pinpoint bias sources in GPT-2 Small and Llama 3.2.

via ArXiv cs.CL#llms#bias#stereotypes
New Research Highlights Hidden Distributions in Language Model Outputs
research

New Research Highlights Hidden Distributions in Language Model Outputs

A new study reveals that language models produce a wide range of outputs, not just single samples. This hidden distributional structure impacts how users interact with and evaluate these models. Researchers found that users often overgeneralize from single outputs, missing critical insights. The study suggests better visualization tools are needed to understand the full spectrum of model behaviors.