The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers
Hao-Ping (Hank) Lee, Ian Drosos, Advait Sarkar, Lev Tankelevitch, Sean Rintel, Richard Banks, Nicholas Wilson
Read the original →What follows is our summary, written for district staff. It is not the paper. If this is going to inform a decision, read the original.
The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers
Article Summary
This study surveyed professionals using AI about: 1) the cognitive effort required to perform tasks with an AI, 2) their confidence in LLM’s outputs, and 3) the critical thinking skills they used when looking at AI outputs. The results showed a decline in professionals’ critical thinking when their confidence in AI outputs is high. Critical thinking when working with AI also occurred at different times in the professionals’ process; for example, verifying information rather than determining where to acquire the information. An important note: the measurement of critical thinking here is self-reported surveys focused on reflection that were completed after performing AI-assisted tasks. A baseline for the amount of critical thinking and reflection for these professionals is not available.