The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performances

Article Summary

Students taking an online coding class were randomly assigned to a group with access to an LLM or a control condition. Using the LLM was associated with higher scores; however, engagement as a whole declined, particularly the group that had access to the LLM.