Skip to main content
Peninsula School District · Gig Harbor, WashingtonOpen source · free to run
Peninsula AI
PreprintSSRNJul 18, 2024

Generative AI Can Harm Learning

Hamsa Bastani, Osbert Bastani, Alp Sungu, Haosen Ge, Özge Kabakcı, Rei Mariman

Read the original →

What follows is our summary, written for district staff. It is not the paper. If this is going to inform a decision, read the original.

Generative AI Can Harm Learning

Article Summary

Students were taught a review lesson and then were randomly assisted to one of three practice sessions: open book with no devices, access to an LLM optimized for tutoring, or access to an LLM with no optimization. Students with no device scored similarly to students using the optimized LLM scored similarly to students who had no device access and better than students with the unoptimized LLM. This suggests that care be taken to custom fit LLMs to their purpose.