Adapting to online learning during COVID-19
At Grok we don’t just work with schools, we also work with universities. We work closely with our university partners to support their innovative teaching methods within our platform, and collaborate on creating content that makes the most of our technology.
In this article we look back at how we’ve collaborated with Melbourne University in response to the recent COVID-19 crisis.
It seems like a long time ago already, but COVID-19 only became a global issue a few months ago as universities were just starting their first semester of the year. Initially the main issue for Australian universities was that international students were unable to fly in to start their studies on campus, raising questions on how to provide a remote learning experience from overseas. Gradually this shifted to the campuses being closed to all students, and the growing need for assessments to be conducted online. Now, even with daily Australian COVID-19 cases down to single digits, there is still caution and uncertainty over on-campus teaching in Semester 2.
Teaching during COVID-19
One of our major customers is the University of Melbourne. Professor Tim Baldwin heads up the COMP10001 Foundations of Programming subject, which regularly has over a thousand students enrolled in Semester 1 each year.
The subject makes heavy use of Grok: there are weekly online programming exercise worksheets; a major project assignment completed online; and a second project in which students write code to play a card game, for which all students’ submissions are pitted against each other in a tournament hosted on the Grok platform. The tutoring team used Grok’s tutor messaging system to provide 1-on-1 help to students struggling on programming problems.
The subject was already well set up to provide a strong online education experience to students, despite being structured around the standard on-campus teaching components of lectures, face-to-face tutorial classes, plus a paper-based mid-semester test and final exam.
Responding with rapid innovation
Every year we use feedback from our users to select new developments to improve our platform, we also provide custom development for users willing to contribute funds to specific work. At the start of 2020 we were already part-way through implementing a rubric-based manual marking system to assist tutors in marking the large number of project submissions for COMP10001. But with COVID-19, Tim asked us whether we could change tack to help with a more urgent issue: how to support online exams.
Grok courses typically focus around formative assessment, in which students make use of automated feedback to incrementally improve their attempts to solve a problem. Exams are very different to formative assessment and present some unique requirements:
- Time limited;
- Strong security safeguards to prevent cheating; and
- Wide range of question styles, beyond writing code and multiple choice; and
- Typically involve manual marking rather than automated testing.
Here’s how we adapted to cover these different requirements. Firstly, we ramped up the development and launch of our new manual marking system so that online exams could be marked by tutors using this system.
Our next step was to adapt the paper exams to a format we could deliver from Grok. Previous exams used a mix of question types, including Parsons-style (rearranging scrambled lines of a function), fill-in-the-blank, plus short-answer and long-answer questions. Rather than build special-purpose problem types for each, we concentrated on making a general-purpose problem type that could be used for all situations.
In parallel to this work, we also developed a new exam session mode, suitable for delivering exam questions to students under timed conditions, along with some security restrictions under the hood.
Additionally, we have extended our plagiarism detection tool’s functionality to work with students’ responses to the exam questions, as a deterrent to academic dishonesty. During exam sessions the students’ work is regularly saved so that the plagiarism detection can spot code-reuse that students may try to hide prior to making a final submission. This can support other tools at the examiners’ disposal, such as remote invigilation, that can be provided externally to Grok.
Conclusions
Although final exams are still to come, the experience so far from our developments has been very positive. The COMP10001 mid-semester test ran successfully, using Grok-based versions of all the questions usually delivered on paper. Moreover, there have been some benefits observed to running the test online. For instance, students’ responses are not obfuscated by poor handwriting. Tutors can also be guided by the outcomes of automated tests students’ submission. We’re also experimenting with providing some simple feedback to students to prevent them from making silly mistakes. More importantly, students have received marks and feedback via the rubric scorecards within Grok, improving the quality of feedback received by students.
What have we gained from this experience? The collaboration between Grok and the University of Melbourne has resulted in improvements that neither party could have achieved alone. We have provided platform improvements and support to allow exams to be provided online to over a thousand students isolated at home within Australia or overseas. We’ve also gained essential feedback and testing of these new developments that have massively improved the final result.
Where next? While this recent work was in response to the crisis directly affecting Semester 1, it is possible that many universities will have a need to run exams to students off-campus during Semester 2, and possibly beyond. Furthermore, running such exams online rather than on paper may continue to be advantageous even after the COVID-19 crisis has passed. For instance, mid-semester quizzes might be well suited to be performed by students under timed conditions at home. And even for invigilated on-site exams, conducting exams online brings the benefits of easier marking.
Whatever happens, we’ve enjoyed our collaboration with such an engaged and enthusiastic teaching team at the University of Melbourne, and the opportunity to develop something to improve the learning experience for students.
To find out more about how Grok Learning can work with you to improve your online learning offerings visit: groklearning.com/universities or contact: uni-support@groklearning.com
