Psychology of Language
This summary builds upon the book ‘The New Psychology of Language’ by T. Dijkstra and D. Peeters (2023).
Course: Psychology of Language
Tilburg University Fall 2024
Midterm: chapter 1 to 6 (30 multiple-choice questions) 35%
Endterm: chapter 1 to 11 (40 multiple-choice, 4 open questions) 65%
Italic concepts in book in yellow
Names in orange
Index
Chapter 1 Basic Assumptions ............................................................................................................................................ 6
1.1 Introduction ............................................................................................................................................................ 6
1.2 Embodiedness ......................................................................................................................................................... 6
1.3 Embeddedness ........................................................................................................................................................ 6
1.4 Mental models ........................................................................................................................................................ 7
1.5 Incremental processing ........................................................................................................................................... 7
1.6 Consequences of this view on language ................................................................................................................. 7
Chapter 2 Language and Communication......................................................................................................................... 8
2.1 Introduction ............................................................................................................................................................ 8
2.2 Verbal and non-verbal communication .................................................................................................................. 8
2.3 Language and communication in context ............................................................................................................... 8
2.4 The medium and the message ................................................................................................................................ 9
2.5 Evolution of communication and language ............................................................................................................ 9
2.6 The sender-receiver model of communication..................................................................................................... 10
Chapter 3 Language User Framework............................................................................................................................. 11
3.1 Introduction .......................................................................................................................................................... 11
3.2 The Language User Framework ............................................................................................................................ 11
3.3 Linguistics and psycholinguistics ........................................................................................................................... 13
Chapter 4 Language Research Techniques ..................................................................................................................... 14
4.1 Introduction .......................................................................................................................................................... 14
4.2 The experimental basics ....................................................................................................................................... 14
4.3 Research techniques measuring word retrieval ................................................................................................... 15
4.3.1 Off-line measurement: memory .................................................................................................................... 15
4.3.2 On-line measurement: behavioral reaction time and neuroscientific studies .............................................. 15
4.4 Behavioral reaction time tasks .............................................................................................................................. 16
4.4.1 Lexical decision: visual and auditory .............................................................................................................. 16
4.4.2 Word naming ................................................................................................................................................. 16
4.4.3 Picture naming ............................................................................................................................................... 17
1
, 4.5 Techniques used at word and sentence level ....................................................................................................... 17
4.5.1 Self-paced reading ......................................................................................................................................... 17
4.5.2 Eye tracking .................................................................................................................................................... 17
4.6 Neurophysiological and neuroimaging techniques .............................................................................................. 18
4.6.1 Electroencephalography (EEG) ...................................................................................................................... 18
4.6.2 Magnetoencephalography (MEG).................................................................................................................. 18
4.6.3 Functional magnetic resonance imaging (fMRI) ............................................................................................ 19
4.6.4 Positron emission topography (PET) .............................................................................................................. 19
4.6.5 Computerized axial tomography (CAT/CT) .................................................................................................... 19
4.7 Combining experimental control with ecological validity..................................................................................... 20
4.7.1 Computer screen paradigms .......................................................................................................................... 20
4.7.2 In-lab interaction paradigms .......................................................................................................................... 20
4.7.3 Virtual reality paradigms ................................................................................................................................ 20
Chapter 5 Recognizing Spoken Words ............................................................................................................................ 21
5.1 Spoken word recognition: the essence ................................................................................................................. 21
5.2 Spoken word recognition: representations .......................................................................................................... 21
5.3 Spoken word recognition: processes .................................................................................................................... 23
5.3.1 Categorical perception ................................................................................................................................... 23
5.3.2 Phoneme restoration ..................................................................................................................................... 23
5.4 Models of spoken word recognition ..................................................................................................................... 23
5.4.1 Cohort model ................................................................................................................................................. 24
5.4.2 TRACE model .................................................................................................................................................. 24
5.4.3 Shortlist model ............................................................................................................................................... 25
5.4.4 Recent computational developments ............................................................................................................ 25
5.4.5 A neurobiological approach to spoken word recognition ............................................................................. 25
5.5 Spoken word recognition: empirical studies......................................................................................................... 25
5.5.1 Lexical embeddings and Cohort’s sequentiality assumption ......................................................................... 26
5.5.2 Speed of spoken word recognition ................................................................................................................ 26
5.5.3 Time-course of spoken word recognition and top-down effects .................................................................. 26
5.6 Spoken word recognition: the role of context ...................................................................................................... 27
5.6.1 Fast effect of linguistic and non-linguistic context on spoken word recognition .......................................... 27
5.6.2 Context effects: The role of your mental model of the speaker.................................................................... 27
5.6.3 Context effects: The role of embodiedness ................................................................................................... 27
Chapter 6 Recognizing Printed and Written Words........................................................................................................ 28
6.1 Printed and written word recognition: the essence ............................................................................................. 28
6.2 Printed and written word recognition: representations ...................................................................................... 28
6.2.1 Letter features and letters ............................................................................................................................. 28
6.2.2 Syllables and morphemes .............................................................................................................................. 29
2
, 6.2.3 Writing systems or scripts: shallow vs. deep orthography ............................................................................ 29
6.3 Printed and written word recognition: processes ................................................................................................ 29
6.3.1 Are words looked up in the lexicon one by one or in parallel? ..................................................................... 30
6.4 Models of visual word recognition ....................................................................................................................... 30
6.4.1 Interactive Activation model .......................................................................................................................... 30
6.4.2 Spatial Coding model ..................................................................................................................................... 31
6.4.3 Dual Route Cascaded model .......................................................................................................................... 32
6.4.4 Multilink model .............................................................................................................................................. 32
6.4.5 Parallel distributed processing models .......................................................................................................... 33
6.4.6 Recent computational developments ............................................................................................................ 33
6.5 Printed and written word recognition: empirical studies ..................................................................................... 33
6.6 Visual word recognition: the role of context ........................................................................................................ 33
Chapter 7 Sentence processing....................................................................................................................................... 34
7.1 Sentence processing: the essence ........................................................................................................................ 34
7.2 Sentence processing: representations .................................................................................................................. 34
7.2.1 Difficult sentences: embedded sentences ..................................................................................................... 35
7.2.2 Difficult sentences: garden path sentences ................................................................................................... 35
7.3 Sentence processing: processes ........................................................................................................................... 35
7.3.1 Incremental processing: tracking the eyes .................................................................................................... 35
7.3.2 Integration of syntactic and semantic information over time ....................................................................... 36
7.3.3. Integration vs. prediction .............................................................................................................................. 36
7.4 Models of sentence processing ............................................................................................................................ 36
7.4.1 Garden Path model ........................................................................................................................................ 36
7.4.2 Referential theory of parsing ......................................................................................................................... 36
7.4.3 Constraint-based model of sentence processing ........................................................................................... 37
7.4.4 Unrestricted race model ................................................................................................................................ 37
7.4.5 Neurobiological models of sentence processing ........................................................................................... 37
7.4.6 Computational models of sentence processing ............................................................................................. 38
7.5 Sentence processing: empirical studies ................................................................................................................ 38
7.6 Sentence processing: the role of context ............................................................................................................. 39
Chapter 8 Meaning ......................................................................................................................................................... 40
8.1 Meaning: the essence ........................................................................................................................................... 40
8.2 Meaning: representations..................................................................................................................................... 40
8.2.1 Sense and reference ...................................................................................................................................... 40
8.2.2 Word meaning representations ..................................................................................................................... 41
8.2.3 Sentence meaning representations ............................................................................................................... 42
8.2.4 Text meaning representations ....................................................................................................................... 42
8.2.5 Meaning in the brain ...................................................................................................................................... 42
3
, 8.3 Meaning: processes .............................................................................................................................................. 42
8.3.1 Embodiedness: effects of other cognitive modalities.................................................................................... 42
8.3.2 Linking the meaning of subsequent sentences by inferences ....................................................................... 43
8.3.3 Thinking and reasoning .................................................................................................................................. 43
8.4 Models of meaning ............................................................................................................................................... 43
8.4.1 Models of sentence and text processing ....................................................................................................... 43
8.5 Meaning: empirical studies ................................................................................................................................... 44
8.5.1 Semantic illusions........................................................................................................................................... 44
8.5.2 Semantic integration of words and pictures .................................................................................................. 44
8.6 Meaning: the role of context ................................................................................................................................ 44
Chapter 9: Language production .................................................................................................................................... 45
9.1 Language production: the essence ....................................................................................................................... 45
9.2 Language production: representations................................................................................................................. 45
9.3 Language production: processes .......................................................................................................................... 45
9.3.1 Language production and the Language User Framework ............................................................................ 45
9.3.2 Conceptualizer ............................................................................................................................................... 46
9.3.3 Formulator ..................................................................................................................................................... 47
9.3.4 Articulator ...................................................................................................................................................... 47
9.4 Models of language production ............................................................................................................................ 48
9.4.1 Slot-and-filler models of language production .............................................................................................. 48
9.4.2 Standard model of language production ....................................................................................................... 48
9.4.3 Interactive Activation model for word production ........................................................................................ 49
9.4.4 Models of tone language production ............................................................................................................ 49
9.4.5 Interface Hypothesis ...................................................................................................................................... 49
9.5 Language production: empirical studies ............................................................................................................... 50
9.5.1 Picture-word interference paradigm ............................................................................................................. 50
9.5.2 Syntactic priming paradigm ........................................................................................................................... 50
9.5.3 Neuroscientific studies ................................................................................................................................... 50
9.5.4 Studies eliciting speech production errors .................................................................................................... 50
9.6 Language production: the role of context ............................................................................................................ 51
9.6.1 Language production in a dialog context ....................................................................................................... 51
9.6.2 Multimodal language production .................................................................................................................. 51
Chapter 10 Multilingualism............................................................................................................................................. 51
10.1 Multilingualism: the essence .............................................................................................................................. 51
10.2 Multilingualism: representations ........................................................................................................................ 51
10.2.1 Cross-linguistic similarity of word representations ..................................................................................... 52
10.2.2 Cross-linguistic similarity of syntactic representations ............................................................................... 53
10.2.3 Storing words and grammar of multiple languages: one or two systems? ................................................. 53
4
, 10.3 Multilingualism: processes.................................................................................................................................. 53
10.3.1 Processing words and sentences in multiple languages: one or two systems? .......................................... 53
10.3.2 The interaction of bottom-up and top-down processes.............................................................................. 53
10.4 Models of multilingual processing and control .................................................................................................. 54
10.4.1 Revised Hierarchical Model ......................................................................................................................... 54
10.4.2 Distributed Conceptual Feature model........................................................................................................ 54
10.4.3 Bilingual Interactive Activation models ....................................................................................................... 54
10.4.4 Multilink model ............................................................................................................................................ 54
10.4.5 Inhibitory and Adaptive Control models ...................................................................................................... 54
10.5 Multilingualism: empirical studies ...................................................................................................................... 55
10.5.1 Multilingual word retrieval .......................................................................................................................... 55
10.5.2 Multilingual sentence processing ................................................................................................................ 55
10.5.3 Multilingual language production and control ............................................................................................ 55
10.6 Multilingualism: the role of context ................................................................................................................... 56
Chapter 11 Conclusion and outlook ................................................................................................................................ 56
11.1 Introduction ........................................................................................................................................................ 56
11.2 Expanding the four basic assumptions of the book ............................................................................................ 56
11.2.1 Embodiedness, multimodality and interactivity .......................................................................................... 56
11.2.2 Embeddedness, symbol hierarchy, and interactivity ................................................................................... 56
11.2.3 Incrementality, time-scale, and interactivity ............................................................................................... 57
11.2.4 The mental model as an interface for language and other cognitive faculties ........................................... 58
11.3 Expanding the Language User Framework ......................................................................................................... 58
11.3.1 The Multimodal Language User Framework ................................................................................................ 58
11.3.2 Language in the overarching cognitive system ............................................................................................ 58
11.4 Biases in the psychology of language ................................................................................................................. 59
11.5 Outlook: diversity, dialog and digital developments .......................................................................................... 59
5
,Chapter 1 Basic Assumptions
1.1 Introduction
4 key aspects of language:
1. Embodiedness: using the body while communicating.
2. Embeddedness: the contexts in which language arises.
3. Mental models: the underlying representations of language.
4. Incremental processing: pieces of information follow each other up.
➔ Interrelated aspects in which language serves as a tool.
1.2 Embodiedness
Humans process language by way of their bodies (eg. reading through the eyes or with the hands for blind people).
Non-verbal information is conveyed through the body. Communication and language are inherently linked to our
senses, to our movements and gestures and to cognition. Communication can take place via all our senses → however,
their importance differs across cultures.
Language comprehension mainly relies on information transmitted via the visual and the auditory modality. Due to the
differences between eyes and ears in their physical properties, the information transferred is different in density and
dimensions. Similar considerations hold for different types of language production. Speaking and writing (or typing)
differ on many dimensions, including articulation, discreteness, speed of information exchange and the information
conveyed.
Language offers a number of tools to encode information efficiently in the utterances of a sender:
◼ Words referring to specific objects or events.
◼ Syntax
◼ Syntactic properties
◼ Co-speech gestures and facial expressions
➔ However, also limitations to express complex concepts and feelings.
➔ This can somewhat be overcome by how a message is sent → the medium is part of the message (cf. 2.4).
1.3 Embeddedness
All language use takes place in context. The perspective of a personality is in a central position, but interacts heavily
with the environment → embeddedness in context.
2 types of non-linguistic context:
1. Physical (bodily) context: language is affected by bodily limitations.
• Eg. articulation, shape of the speech organs.
2. Social and cultural context: language is fine-tuned to the social and cultural context they occur in.
• Eg. babytalk with children.
• Verbal and non-verbal aspects play a role.
• Cultural frame shifting = the impact of cultural norms of a particular language community on the speaker’s
personality as they themselves or others perceive it (mostly in bilinguals).
Generally in language comprehension, information about the context is added to the meaning of the utterance itself
by the addressee of the message. This meaning may concern information about the past, present or future of the body
or the world. In language production, this process is the other way around → the speaker/signer links a meaning to an
utterance taking into account available information about the (verbal and non-verbal) context in which the utterance
is made.
Linguistic context = our knowledge about the different levels of the language in use (eg. semantic or syntax).
➔ Theories and models of language use and language processing must take the various types of context into
account when trying to explain the mental processes that support our linguistic abilities.
6
,1.4 Mental models
Human beings try to make sense of the world surrounding them → this happens through internal models, i.e. a
simplified approximation of aspects that are relevant for physical and social survival.
The current situation is represented in terms of various aspects:
◼ Physical: gravity, color, material objects, loudness.
◼ Biological: perception, bodily senses and movement.
◼ Psychological: emotional value or abstract meaning.
◼ Sociological: your role in relation to others.
➔ Intertwined concepts.
A mental model represents information about content but also about other aspects of information present. Mental
models develop over time. When new information arrives, the mental model is dynamically adapted in order to
represent it in a detailed way, making use of space, time causality and intentions.
To understand what another person is saying, we must compare the incoming signal to stored information about
language: word information in our long term memory, word order information, but also meaning and world knowledge.
Therefore, mental models are updated all the time.
Mental models are important:
1. Mental models contain both abstract and embodied information.
2. Mental models must imply coherent brain activity in which different modalities participate and interact.
3. Language processing can go to different depths and involve different stages.
1.5 Incremental processing
Mental models are multidimensional, but language processing is one-dimensional (like a timeline). Pieces of
information are processed incrementally → a series of different elements that follow one another in time and build on
each other. Language is hierarchically organized, such that smaller elements (eg. sounds) are usually part of larger
elements (eg. words). Incrementality seems to hold for both smaller and larger pieces of information. Efficient
processing implies that receivers do not wait until the utterance is finished, but process all information they can at
each moment in time and predict what is coming next. Speech can be accompanied by hand gestures and meaningful
facial expressions.
1.6 Consequences of this view on language
The four aspects of language as described here have consequences on the view on language:s
◼ Phylogenesis = language evolution in humans.
o We should consider language evolution in terms of the human body and human society (eg. language
families/language trees).
◼ Ontogenesis = language development in the human child.
o The embodiedness assumption stresses the importance of the genetic bases of language, while the
embeddedness assumption considers language acquisition in relation to social and physically oriented
interactions with caretakers, as well as cognitive aspects having to do with attention, memory and
cognitive control.
Discussion box 1
Embodiedness vs. embodiment
The term ‘embodiment’ implies a stronger reliance of language on other modalities than is advocated in this book,
which proposes that we possess both abstract and more sense-oriented conceptual representations. Embodiedness
implies that our body is involved in many of our communicative activities.
7
, Chapter 2 Language and Communication
2.1 Introduction
Communication (short) = the exchange of information, ideas or feelings.
◼ The term ‘communication’ has a broader application than the term ‘language’ does.
◼ Communication can be seen as a transaction; participants make meaning together.
◼ Communication is also done to influence others, to develop relationships and to fulfil social obligations.
◼ Humans need communication → therefore, broader definition.
Communication (broad) = every action with which a person exchanges information about needs, desires, perceptions,
knowledge, or affective states.
◼ Can be intentional or unintentional.
◼ Can proceed via conventional or non-conventional signals.
◼ Can proceed via linguistic or non-linguistic signals.
◼ Can proceed via spoken or other channels.
2.2 Verbal and non-verbal communication
A distinction can be made between non-verbal communication/body language and verbal communication or language.
However, these non-verbal signals contribute to verbal communication and vice versa. Our cognitive systems are non-
modular = i.e. not functioning as fully independent systems.
➔ Eg. sign language relies not only on manual information but also facial and lip movements.
➔ Eg. pointing as an example in which verbal and non-verbal types of information often come together. “The
train station is right that way” [pointing towards ‘that way’].
➔ Eg. McGurk effect = listening to the sound ‘ba’ with lip movements of the sound ‘ga’. Listeners then heard the
sound ‘da’.
o This finding indicates that the brain continuously integrates visual bodily and auditory linguistic
information → evidence for non-modularity.
The verbal and non-verbal signals that we produce as communicators can be classified into different subcategories as
a function of how they refer to something.
◼ Indexical = the relation between sign and its referent (eg. smoke refers to fire).
◼ Iconic = their form physically resembles their meaning (eg. the sound ‘beep’).
◼ Symbolic = the link between form and meaning is arbitrary and therefore culturally learned (eg. ‘tree’ does not
look or sound like a tree).
2.3 Language and communication in context
Communication, including language, always takes place in a specific context (cf. embeddedness, chapter 1). When
communicating, participants rely on mutual, shared knowledge or common ground. They build up and rely on
knowledge they share with their specific interlocutor(s) and also take into account what knowledge and beliefs any
member of their community is assumed to possess.
➔ Eg. conversations with a right-wing politician will be different than conversations with your toddler.
➔ Therefore, not only the physical situation, but also the psychological and the cultural situation contribute to
the information exchange.
➔ Context changes the words that are used in a conversation: ‘I’ versus ‘us’, or ‘here’ versus ‘there’.
Because knowledge systems can be very different across individuals, this implies that the information sent is not always
the same as the information received → distorted information may lead to difference of opinion, or miscommunication.
Inherent to communication is that participants bring important non-linguistic characteristics to the communicative
situation that affect linguistic communication.
➔ Eg. gender, cultural background, relation between sender and receiver (cf. 2.6).
Communication often takes place in noisy situations.
◼ Noise = any stimulus, external or internal, that disrupts the sharing of meaning.
8