Verbal Report

Definition:

Data collected by asking participants to describe their own mental processes — thoughts, strategies, and decisions — either while performing a task (concurrent) or after completing it (retrospective).


In-Depth Explanation

Verbal reports are the primary method for accessing internal cognitive processes that leave no external trace. A reading comprehension score shows whether a learner understood a text; a verbal report shows how they went about understanding it.

Ericsson and Simon (1993) provided the foundational theoretical treatment, distinguishing three types:

Type 1 — Verbal reports of heeded information: What is already in verbal form in working memory is simply reported. Example: “I was thinking, is this word related to ‘construct’?”

Type 2 — Verbal reports requiring additional verbalization: Information in non-verbal form must be translated into words. Less reliable because the translation process can alter or distort the original.

Type 3 — Verbal reports with explanation: Participants report and explain their processes. Most prone to rationalization and post-hoc reconstruction.

In SLA research, verbal reports fall into two broad categories:

Concurrent (on-line): Produced while the task is in progress.

  • Think-aloud protocols: The learner says everything they think while reading, writing, or solving a grammar problem.
  • Advantage: Real-time; disadvantage: disruptive to natural performance.

Retrospective (off-line): Produced after the task.

  • Unaided retrospective interview: “What were you thinking when you wrote that sentence?”
  • Stimulated recall: “Let’s look at the recording — what were you thinking here?”
  • Advantage: Non-disruptive; disadvantage: memory decay and rationalization.

Verbal reports are often combined with other data sources — observable performance, eye-tracking, computer keystroke logging — to triangulate findings and compensate for the limitations of each method alone.


History

Introspectionism in early 20th century psychology relied on trained observers reporting their own mental states. After the behaviorist rejection of all mentalist methods, verbal report re-entered cognitive psychology in the 1970s, rehabilitated by Ericsson and Simon’s (1972, 1980, 1993) rigorous treatment of the conditions under which verbal reports are valid data. Applied linguistics adopted the method in the 1970s–80s for reading strategy and writing process research.


Common Misconceptions

“Verbal reports give direct access to mental processes.” Verbal reports are retrospective reconstructions (in most cases), shaped by memory, language, and social expectations about what one should have been thinking. They are evidence about cognition, not transparent records of it.

“Concurrent reports are always better.” For highly automatized processes, concurrent verbalization either fails (nothing to report because processing is below conscious threshold) or disrupts the process (imposing deliberate thinking where automatic processing would otherwise occur).


Criticisms

  • The reactivity problem: asking learners to report their thoughts changes the thoughts they have. Concurrent verbalization of grammatical decisions may increase metalinguistic monitoring, producing different behavior than non-verbalized performance.
  • The boundary between what was actually in mind and what the participant believes was in mind (or thinks should have been in mind) is hard to establish.
  • Verbal reports are resource-intensive to collect and code; many SLA studies using them have very small samples.

Social Media Sentiment

Verbal reports as a formal research method have no significant presence in lay language learning communities. However, the informal equivalent — language learners explaining their thought processes while studying, or narrating their SRS reviews — is common on YouTube and Twitch (“study with me” streams), and constitutes informal verbal report data.


Related Terms


Research

  • Ericsson, K. A., & Simon, H. A. (1993). Protocol Analysis: Verbal Reports as Data (rev. ed.). MIT Press.
  • Cohen, A. D. (1998). Strategies in Learning and Using a Second Language. Longman.
  • Gass, S., & Mackey, A. (2000). Stimulated Recall Methodology in Second Language Research. Lawrence Erlbaum.