Fork the consciousness, or download the project and create your own.

Tal Linzen

Department of Linguistics and Center for Data Science, New York University

Critic Current evidence and current methods do not support the claims being made

Tal Linzen is Associate Professor of Linguistics and Data Science at New York University, where he directs the Computation and Psycholinguistics Lab, and a research scientist who has worked extensively on targeted diagnostic evaluations of neural network representations.

In Can LLMs Introspect? A Reality Check (arXiv:2605.26242, May 2026), co-authored with Shashwat Singh and Shauli Ravfogel, Linzen audited the two primary experimental paradigms used to claim that large language models possess introspective self-knowledge, namely activation intervention detection and hidden-state prediction. By introducing external input-only classifiers and relabeled control conditions that strip surface semantic correlations from the prompt, Singh, Linzen, and Ravfogel demonstrated that apparent introspective accuracy in standard evaluation setups often collapses to near-chance or can be matched by an observer with zero access to the model’s internal activations.

Linzen is classified as a Critic on this site. His work establishes strict methodological baselines that any claim of machine introspection or higher-order self-monitoring must clear before behavioral or steering-vector reports are treated as evidence of privileged internal access.

Known for. Can LLMs Introspect? A Reality Check, mechanistic evaluation of syntactic and metacognitive claims in language models

Coverage on this site

Related researchers