Robo Invigilation: Does it work? Is it ethical?

A reading group, and an entirely unofficial CPD event. We are open to anybody interested in digital education / e-learning.We meet thefirst Thursday of each month, 6.00-7.30pm with a different topic and venue each month. We use the texts as a springboard to discuss our own practices in digital education.

London E-Learning Reading Group

Covid has accelerated a move to online assessment, and where there is a will to hold those assessments as unseen examinations under control.

What is remote invigilation (aka remote proctoring)?In 2020 SURF (Netherlands organisation to support technologies in education and research) updated its 2016 white paper on remote proctoring. The updates take into account the intensified interest in digital invigilation due to Covid19, the potential and limitations of remote proctoring, and concerns about privacy.<ul><li><a href="https://www.surf.nl/files/2020-06/surf-whitepaper-online-proctoring_en_mei-2020.pdf" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer">SURF white paper on remote proctoring</a>, 2020. Read the summary, and to get a sense of what online proctoring is attempting to eliminate and how it works, read 5.2 of the updated report. For an approach to categorising assessment security, read 5.4.1.</li></ul>One of the fastest growing invigilation companies is Proctorio. Its critics say that its business model (unlimited use for a flat rate) has led to scope-creep i.e. invigilation increasingly happening with low-stakes and low-risk assessment (see the SURF model above) as well as for the originally-intended high stakes exams which could, for example, gain you a licence to practise as a doctor, engineer or lawyer. <a href="https://www.edsurge.com/news/2020-11-13-pushback-is-growing-against-automated-proctoring-services-but-so-is-their-use" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer">Proctorio&#x27;s CEO says that the software is now used weekly on 2-4 million students</a>. Actually, he says it&#x27;s used &quot;by&quot; them - but there&#x27;s the rub.In September, Proctorio launched a lawsuit against a learning technologist at the University of British Columbia called Ian Linkletter (@Linkletter) for criticising material they had published. Linkletter&#x27;s affidavit includes a number of exhibits about inequalities in remote proctoring which are useful in judging software.<ul><li><a href="https://drive.google.com/drive/folders/1OjxaRjRfe0BLh_A6rcyc9lCmdfZ5nEm-" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer">Linkletter&#x27;s affidavit</a>, paragraphs 21-30 relating to Exhibits E-J. These paragraphs relate to student anxiety, accessibility and racial discrimination.</li><li>(Extension reading) <a href="https://www.dailycal.org/2020/04/05/online-exam-proctoring-no-longer-allowed-for-uc-berkeley-classes/" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer">Online proctoring no longer allowed for UC Berkley classes</a> - one case from rising global concerns about online proctoring.</li></ul>Should we factor in these reductions in privacy and well-being as the necessary side effects of using examinations? After all, stakes have never been higher for students. Higher education is expensive and the jobs situation is currently dire. For these reasons students are often at the front of calls for better assessment security - if there are opportunities to cheat then the degree becomes less respectable and less competitive. Everybody recognises that processes that reward cheating aren&#x27;t fair or fit, no matter how creative the cheating.An alternative question: can the need for controlled conditions be designed out while maintaining assessment security for high-stakes, high-risk assessment, maintaining the breadth of learning associated with unseen exams while also promoting the depth and longevity of learning which typically isn&#x27;t? A choice of readings:<ul><li><a href="https://twitter.com/CT_Bergstrom/status/1322369355930165248" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer">Carl Bergstrom has a Twitter thread with a science focus, on turning the internet into a resource rather than a source</a>.</li><li>Towards non-disposable assessments: Seraphin, S. B., Grizzell, J. A., Kerr-German, A., Perkins, M. A., Grzanka, P. R., &amp; Hardin, E. E. (2019). A Conceptual Framework for Non-Disposable Assignments: Inspiring Implementation, Innovation, and Research. Psychology Learning &amp; Teaching, 18(1), 84–97. <a href="https://doi.org/10.1177/1475725718811711" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer">https://doi.org/10.1177/1475725718811711</a></li><li>If your library has it (or see Google Books), read the Introduction to Sambell, K., McDowell, L., &amp; Montgomery, C. (2013). Assessment for learning in higher education. Taylor and Francis.</li><li><a href="https://ahenetwork.org/keynote-address-phill-dawson-ahe-2019/" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer">Why you should cheat</a>. Watch Phill Dawson&#x27;s keynote at the 2019 Assessment in Higher Education conference.</li></ul>We look forward to discussing these with you at the reading group.

Our {communityGuidelinesLink} describe the sort of content we prohibit on Eventbrite. If you suspect an event may be in violation, you can report it to us so we can investigate.

To report other categories of prohibited or illegal content, submit {link}

Robo Invigilation: Does it work? Is it ethical?

More events from London E-Learning Reading Group

Follow organisers to get events picked for you

Robo Invigilation: Does it work? Is it ethical?

More events from London E-Learning Reading Group

Follow organisers to get events picked for you

You might also like...

Browse more events with different dates, prices, and formats to find your next great experience.