PreprintArxivApr 25, 2024
The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performances
Allen Nie, Yash Chandak, Miroslav Suzara, Malika Ali, Juliette Woodrow, Matt Peng, Mehran Sahami, Emma Brunskill, Chris Piech
Read the original →What follows is our summary, written for district staff. It is not the paper. If this is going to inform a decision, read the original.
The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performances
Article Summary
Students taking an online coding class were randomly assigned to a group with access to an LLM or a control condition. Using the LLM was associated with higher scores; however, engagement as a whole declined, particularly the group that had access to the LLM.
Related across the site
ToolsAI StudioOpen-source platform providing secure access to frontier AI models like GPT-5, Claude Opus, and Google Gemini for K-1…ToolsChatGPTAI-powered conversational assistant for a wide range of tasks, including education, research, and productivity.Use casesChatGPT For Game Development AssitanceUsing the ChatGPT Extension in VS Code to assist students with Game DevelopmentUse casesCreating API Integration Scripts for Network SecurityUsing AI to write integrations with Have I Been Pwned AI to check passwords