Can AI Infiltrate University Exams Systems?

Artificial intelligence (AI) systems such as ChatGPT pose a fundamental problem for the educational sector. Ponder what would happen if students could upload their assessment questions to an AI such as ChatGPT, ask it to answer them, submit the unedited answers, and gain better grades then if they did the work themselves. This talk presents the results of a real-world test of artificial intelligence infiltration of a university examinations system, which showed this very thing can happen. AI submissions were virtually undetectable and robustly outperformed real students.

Dr Peter Scarfe discusses how this work has shaped educational policy and reflects upon broader implications for ascertaining 'trust' and 'truth' in a world with AI.

Collaborators: Professor Etienne Roesch (University of Reading), Kelly Watcham (University of Reading), and Dr Alasdair Clarke (University of Essex).

You do not need any prior knowledge of AI to enjoy this event.

Speaker

Dr Peter Scarfe is an Associate Professor in Psychology at the University of Reading, where he heads a virtual reality and robotics lab. In 2023, together with colleagues, he conducted the first real-world "Turing Test" for the detectability of AI generated submissions in a real-world university examinations system. The results showed that 100% AI generated exam submissions were virtually undetectable and robustly outperformed real student submissions. In-between teaching and running a research lab, he is actively involved in training and policy regarding AI and education at Reading. Visit the Vision and Haptics Laboratory website or read the full paper.

King's Festival of Artificial Intelligence

This event is part of the King’s Festival of Artificial Intelligence. Running from Tuesday 20 May to Saturday 24 May, the free, five-day festival brings together a diverse line-up of experts to consider critical questions about artificial intelligence in the context of healthcare, education, sustainability, policy, and creativity.

If you are interested in this event, you may also want to join us for:

• A day of events looking at AI in education, including: Beyond the Hype: AI and Education panel and AI in Education Showcase: Lightning Presentations.
• One or more of a range of workshops considering use cases of AI in education: Navigating the ‘Grey Area’: Developing Critical AI Literacy in Student Assessments, Let’s AI-Prep Together: A Student and Teacher Dialogue, Using GenAI to Enhance Understanding in Dissertation Projects, Reimagining Placements: A Hypothetical GP Surgery Using AI Interaction, Revising with Robots: AI Hacks for Uni Success.

Festival events will take place across several King’s venues, so please check carefully where the event is taking place. Festival event times may be subject to change. Any changes will be communicated to attendees via Eventbrite emails.

Please note, King's events are free, which means we routinely overbook to allow for no-shows and avoid empty seats. Admission is on a first come, first served basis, so please arrive in good time to avoid disappointment. We will not be able to admit those without tickets or latecomers.