Where meaning lives: Layer-wise accessibility of psycholinguistic features in encoder and decoder language models

"Understanding where transformer language models encode psychologically meaningful aspects of meaning is essential for both theory and practice. We conduct a systematic layer-wise probing study of 58 psycholinguistic features across 10 transformer models, spanning encoder-only and decoder-only archit..."