Psychology of Language
This summary builds upon the book ‘The New Psychology of Language’ by T. Dijkstra and D. Peeters (2023).
Course: Psychology of Language
Tilburg University Fall 2024
Midterm: chapter 1 to 6 (30 multiple-choice questions) 35%
Endterm: chapter 1 to 11 and article Gervan and Mehler (2010) (part multiple-choice, part open questions) 65%
Italic concepts in book in yellow
Names in orange
Index
Chapter 1 Basic Assumptions ............................................................................................................................................ 4
1.1 Introduction ............................................................................................................................................................ 4
1.2 Embodiedness ......................................................................................................................................................... 4
1.3 Embeddedness ........................................................................................................................................................ 5
1.4 Mental models ........................................................................................................................................................ 5
1.5 Incremental processing ........................................................................................................................................... 6
1.6 Consequences of this view on language ................................................................................................................. 6
Chapter 2 Language and Communication......................................................................................................................... 6
2.1 Introduction ............................................................................................................................................................ 6
2.2 Verbal and non-verbal communication .................................................................................................................. 7
2.3 Language and communication in context ............................................................................................................... 7
2.4 The medium and the message ................................................................................................................................ 7
2.5 Evolution of communication and language ............................................................................................................ 8
2.6 The sender-receiver model of communication....................................................................................................... 9
Chapter 3 Language User Framework............................................................................................................................... 9
3.1 Introduction ............................................................................................................................................................ 9
3.2 The Language User Framework .............................................................................................................................. 9
3.3 Linguistics and psycholinguistics ........................................................................................................................... 12
Chapter 4 Language Research Techniques ..................................................................................................................... 13
4.1 Introduction .......................................................................................................................................................... 13
4.2 The experimental basics ....................................................................................................................................... 13
4.3 Research techniques measuring word retrieval ................................................................................................... 13
4.3.1 Off-line measurement: memory .................................................................................................................... 13
4.3.2 On-line measurement: behavioral reaction time and neuroscientific studies .............................................. 14
4.4 Behavioral reaction time tasks .............................................................................................................................. 15
4.4.1 Lexical decision: visual and auditory .............................................................................................................. 15
4.4.2 Word naming ................................................................................................................................................. 15
4.4.3 Picture naming ............................................................................................................................................... 16
1
, 4.5 Techniques used at word and sentence level ....................................................................................................... 16
4.5.1 Self-paced reading ......................................................................................................................................... 16
4.5.2 Eye tracking .................................................................................................................................................... 16
4.6 Neurophysiological and neuroimaging techniques .............................................................................................. 17
4.6.1 Electroencephalography (EEG) ...................................................................................................................... 17
4.6.2 Magnetoencephalography (MEG).................................................................................................................. 17
4.6.3 Functional magnetic resonance imaging (fMRI) ............................................................................................ 18
4.6.4 Positron emission topography (PET) .............................................................................................................. 18
4.6.5 Computerized axial tomography (CAT/CT) .................................................................................................... 18
4.7 Combining experimental control with ecological validity..................................................................................... 19
4.7.1 Computer screen paradigms .......................................................................................................................... 19
4.7.2 In-lab interaction paradigms .......................................................................................................................... 19
4.7.3 Virtual reality paradigms ................................................................................................................................ 19
Chapter 5 Recognizing Spoken Words ............................................................................................................................ 20
5.1 Spoken word recognition: the essence ................................................................................................................. 20
5.2 Spoken word recognition: representations .......................................................................................................... 20
5.3 Spoken word recognition: processes .................................................................................................................... 22
5.3.1 Categorical perception ................................................................................................................................... 22
5.3.2 Phoneme restoration ..................................................................................................................................... 22
5.4 Models of spoken word recognition ..................................................................................................................... 22
5.4.1 Cohort model ................................................................................................................................................. 23
5.4.2 TRACE model .................................................................................................................................................. 23
5.4.3 Shortlist model ............................................................................................................................................... 24
5.4.4 Recent computational developments ............................................................................................................ 24
5.4.5 A neurobiological approach to spoken word recognition ............................................................................. 24
5.5 Spoken word recognition: empirical studies......................................................................................................... 24
5.5.1 Lexical embeddings and Cohort’s sequentiality assumption ......................................................................... 25
5.5.2 Speed of spoken word recognition ................................................................................................................ 25
5.5.3 Time-course of spoken word recognition and top-down effects .................................................................. 25
5.6 Spoken word recognition: the role of context ...................................................................................................... 26
5.6.1 Fast effect of linguistic and non-linguistic context on spoken word recognition .......................................... 26
5.6.2 Context effects: The role of your mental model of the speaker.................................................................... 26
5.6.3 Context effects: The role of embodiedness ................................................................................................... 26
Chapter 6 Recognizing Printed and Written Words........................................................................................................ 27
6.1 Printed and written word recognition: the essence ............................................................................................. 27
6.2 Printed and written word recognition: representations ...................................................................................... 27
6.2.1 Letter features and letters ............................................................................................................................. 27
6.2.2 Syllables and morphemes .............................................................................................................................. 28
2
, 6.2.3 Writing systems or scripts: Shallow vs. deep orthography ............................................................................ 28
6.3 Printed and written word recognition: processes ................................................................................................ 28
6.3.1 Are words looked up in the lexicon one by one or in parallel? ..................................................................... 29
6.4 Models of visual word recognition ....................................................................................................................... 29
6.4.1 Interactive Activation model .......................................................................................................................... 29
6.4.2 Spatial Coding model ..................................................................................................................................... 30
6.4.3 Dual Route Cascaded model .......................................................................................................................... 31
6.4.4 Multilink model .............................................................................................................................................. 32
6.4.5 Parallel distributed processing models .......................................................................................................... 32
6.4.6 Recent computational developments ............................................................................................................ 32
6.5 Printed and written word recognition: empirical studies ..................................................................................... 32
6.5.1 Speed of written word recognition ................................................................................................................ 33
6.5.2 Activation of phonology in word reading ...................................................................................................... 33
6.5.3 Activation of orthography during listening .................................................................................................... 33
6.6 Visual word recognition: the role of context ........................................................................................................ 33
6.6.1 Cross-modal priming with lexical decision ..................................................................................................... 33
6.6.2 Predicting words in sentence context ............................................................................................................ 33
Chapter 7 Sentence processing....................................................................................................................................... 33
7.1 Sentence processing: the essence ........................................................................................................................ 33
7.2 Sentence processing: representations .................................................................................................................. 34
7.2.1 Difficult sentences: embedded sentences ..................................................................................................... 35
7.2.2 Difficult sentences: garden path sentences ................................................................................................... 35
7.3 Sentence processing: processes ........................................................................................................................... 35
7.3.1 Incremental processing: tracking the eyes .................................................................................................... 35
7.3.2 Integration of syntactic and semantic information over time ....................................................................... 35
7.3.3. Integration vs. prediction .............................................................................................................................. 36
7.4 Models of sentence processing ............................................................................................................................ 36
7.4.1 Garden Path model ........................................................................................................................................ 36
7.4.2 Referential theory of parsing ......................................................................................................................... 36
7.4.3 Constraint-based model of sentence processing ........................................................................................... 36
7.4.4 Unrestricted race model ................................................................................................................................ 37
7.4.5 Neurobiological models of sentence processing ........................................................................................... 37
7.4.6 Computational models of sentence processing ............................................................................................. 38
7.5 Sentence processing: empirical studies ................................................................................................................ 38
7.6 Sentence processing: the role of context ............................................................................................................. 39
Chapter 8 Meaning ......................................................................................................................................................... 39
8.1 Meaning: the essence ........................................................................................................................................... 39
8.2 Meaning: representations..................................................................................................................................... 40
3
, 8.2.1 Sense and reference ...................................................................................................................................... 40
8.2.2 Word meaning representations ..................................................................................................................... 40
8.2.3 Sentence meaning representations ............................................................................................................... 41
8.2.4 Text meaning representations ....................................................................................................................... 41
8.2.5 Meaning in the brain ...................................................................................................................................... 42
8.3 Meaning: processes .............................................................................................................................................. 42
8.3.1 Embodiedness: effects of other cognitive modalities.................................................................................... 42
8.3.2 Linking the meaning of subsequent sentences by inferences ....................................................................... 42
8.3.3 Thinking and reasoning .................................................................................................................................. 42
8.4 Models of meaning ............................................................................................................................................... 43
8.4.1 Models of sentence and text processing ....................................................................................................... 43
8.5 Meaning: empirical studies ................................................................................................................................... 43
8.5.1 Semantic illusions........................................................................................................................................... 43
8.5.2 Semantic integration of words and pictures .................................................................................................. 44
8.6 Meaning: the role of context ................................................................................................................................ 44
8.6.1 Finding the correct referent using prosody ................................................................................................... 44
8.6.2 From literal to non-literal meaning: the larger discourse context................................................................. 44
Chapter 9: Language production .................................................................................................................................... 44
9.1 Language production: the essence ....................................................................................................................... 44
9.2 Language production: representations................................................................................................................. 44
9.3 Language production: processes .......................................................................................................................... 45
9.3.1 Language production and the Language User Framework ............................................................................ 45
Chapter 1 Basic Assumptions
1.1 Introduction
4 key aspects of language:
1. Embodiedness: using the body while communicating.
2. Embeddedness: the contexts in which language arises.
3. Mental models: the underlying representations of language.
4. Incremental processing: pieces of information follow each other up.
➔ Interrelated aspects in which language serves as a tool.
1.2 Embodiedness
Humans process language by way of their bodies (eg. reading through the eyes or with the hands for blind people).
Non-verbal information is conveyed through the body. Communication and language are inherently linked to our
senses, to our movements and gestures and to cognition. Communication can take place via all our senses → however,
their importance differs across cultures.
4
,Language comprehension mainly relies on information transmitted via the visual and the auditory modality. Due to the
differences between eyes and ears in their physical properties, the information transferred is different in density and
dimensions. Similar considerations hold for different types of language production. Speaking and writing (or typing)
differ on many dimensions, including articulation, discreteness, speed of information exchange and the information
conveyed.
Language offers a number of tools to encode information efficiently in the utterances of a sender:
◼ Words referring to specific objects or events.
◼ Syntax
◼ Syntactic properties
◼ Co-speech gestures and facial expressions
➔ However, also limitations to express complex concepts and feelings.
➔ This can somewhat be overcome by how a message is sent → the medium is part of the message (cf. 2.4).
1.3 Embeddedness
All language use takes place in context. The perspective of a personality is in a central position, but interacts heavily
with the environment → embeddedness in context.
2 types of non-linguistic context:
1. Physical (bodily) context: language is affected by bodily limitations.
• Eg. articulation, shape of the speech organs.
2. Social and cultural context: language is fine-tuned to the social and cultural context they occur in.
• Eg. babytalk with children.
• Verbal and non-verbal aspects play a role.
• Cultural frame shifting = the impact of cultural norms of a particular language community on the speaker’s
personality as they themselves or others perceive it (mostly in bilinguals).
Generally in language comprehension, information about the context is added to the meaning of the utterance itself
by the addressee of the message. This meaning may concern information about the past, present or future of the body
or the world. In language production, this process is the other way around → the speaker/signer links a meaning to an
utterance taking into account available information about the (verbal and non-verbal) context in which the utterance
is made.
Linguistic context = our knowledge about the different levels of the language in use (eg. semantic or syntax).
➔ Theories and models of language use and language processing must take the various types of context into
account when trying to explain the mental processes that support our linguistic abilities.
1.4 Mental models
Human beings try to make sense of the world surrounding them → this happens through internal models, i.e. a
simplified approximation of aspects that are relevant for physical and social survival.
The current situation is represented in terms of various aspects:
◼ Physical: gravity, color, material objects, loudness.
◼ Biological: perception, bodily senses and movement.
◼ Psychological: emotional value or abstract meaning.
◼ Sociological: your role in relation to others.
➔ Intertwined concepts.
A mental model represents information about content but also about other aspects of information present. Mental
models develop over time. When new information arrives, the mental model is dynamically adapted in order to
represent it in a detailed way, making use of space, time causality and intentions.
5
, To understand what another person is saying, we must compare the incoming signal to stored information about
language: word information in our long term memory, word order information, but also meaning and world knowledge.
Therefore, mental models are updated all the time.
Mental models are important:
1. Mental models contain both abstract and embodied information.
2. Mental models must imply coherent brain activity in which different modalities participate and interact.
3. Language processing can go to different depths and involve different stages.
1.5 Incremental processing
Mental models are multidimensional, but language processing is one-dimensional (like a timeline). Pieces of
information are processed incrementally → a series of different elements that follow one another in time and build on
each other. Language is hierarchically organized, such that smaller elements (eg. sounds) are usually part of larger
elements (eg. words). Incrementality seems to hold for both smaller and larger pieces of information. Efficient
processing implies that receivers do not wait until the utterance is finished, but process all information they can at
each moment in time and predict what is coming next. Speech can be accompanied by hand gestures and meaningful
facial expressions.
1.6 Consequences of this view on language
The four aspects of language as described here have consequences on the view on language:
◼ Phylogenesis = language evolution in humans.
o We should consider language evolution in terms of the human body and human society (eg. language
families/language trees).
◼ Ontogenesis = language development in the human child.
o The embodiedness assumption stresses the importance of the genetic bases of language, while the
embeddedness assumption considers language acquisition in relation to social and physically oriented
interactions with caretakers, as well as cognitive aspects having to do with attention, memory and
cognitive control.
Discussion box 1
Embodiedness vs. embodiment
The term ‘embodiment’ implies a stronger reliance of language on other modalities than is advocated in this book,
which proposes that we possess both abstract and more sense-oriented conceptual representations. Embodiedness
implies that our body is involved in many of our communicative activities.
Chapter 2 Language and Communication
2.1 Introduction
Communication (short) = the exchange of information, ideas or feelings.
◼ The term ‘communication’ has a broader application than the term ‘language’ does.
◼ Communication can be seen as a transaction; participants make meaning together.
◼ Communication is also done to influence others, to develop relationships and to fulfil social obligations.
◼ Humans need communication → therefore, broader definition.
Communication (broad) = every action with which a person exchanges information about needs, desires, perceptions,
knowledge, or affective states.
◼ Can be intentional or unintentional.
◼ Can proceed via conventional or non-conventional signals.
◼ Can proceed via linguistic or non-linguistic signals.
◼ Can proceed via spoken or other channels.
6
