Assessment drives learning within higher education – evidently, assessment for learning and authentic assessment design have become ultimate goals for educators and universities. The rapid shift to online assessment through the COVID19 pandemic brought about considerable changes and innovation in our ways of thinking about student experiences with assessment and feedback. More recently, the disruption of generative AI (e.g. ChatGPT) added a further challenge to our teaching and assessment practice. Together, this has called for a strategic initiative to specifically enhance digital assessment and feedback practice.
Currently, most programmes within the Faculty of Medicine and Dentistry (FMD) utilise tools built into the Learner Management System (LMS), including Turnitin as a plagiarism and collusion-checking tool. To enhance the student and staff experience on digital assessment and feedback, and to mitigate any academic integrity issues, the Dean for Digital Education and the Digital Education Studio undertook a market review of external digital assessment tools which would complement existing assessment practices.
There is an abundance of educational technologies and tools used for assessment and feedback in the market. The rubric for eLearning Tool Evaluation (EDUCAUSE) was used to assess the suitability of digital assessment tools to address the problems noted above. Cadmus then stood out and scored highly on all criteria (i.e. functionality, accessibility, technical, mobile design, privacy, data, protection and rights, social presence, teaching presence, cognitive presence). Also with evidence from their previous work and successful pilots with other universities in Australia, the UK and the US, Cadmus was selected to conduct a pilot project on digital assessment and feedback.
Cadmus is an ‘assessment for learning’ platform. The tool comes with a range of assessment design templates and scaffolds the assessment and feedback (both summative and formative) processes for teachers and students. It also provides support for students particularly on academic writing skills development, as well as providing teachers necessary learning analytics to give personalized academic support to individual students.
A shared goal of the academic pilot team and the Cadmus team is to maintain a focus on fundamental teaching and learning principles, to ensure that measurable assessment outcomes are rooted in a pedagogically-supported learning experience.
While there is a variety of assessment formats within FMD, this pilot project focuses on written assessment, which mostly resides within ‘assessed coursework’. Aside from exams, this is one of the most frequently used assessment formats in FMD, providing academic teams an opportunity for assessment redesign to support academic integrity and reduce any cases of misconduct.
With this background, the project therefore aims to address three wicked problems:
In close collaboration with Queen Mary Academy, Technology Enhanced Learning Team (TELT), the Faculty of Humanities and Social Sciences (HSS), selected module leads from FMD institutes, and with the support of Cadmus team, the Digital Education Studio enlisted existing e-learning professionals from each institute to support academics on this innovative practice.
The pilot project began in June 2023, with Cadmus being used by academics to re-design the assessments within their Semesters 1 and 2 modules. Based on an agreed evaluation framework, the project team evaluates the effectiveness of the pilot and tool in practice in January 2024 and in August 2024 for Semesters 1 and 2 respectively. The below section illustrates the interim results of the pilot project and it is very encouraging.
In the academic year of 2023/24, 8 modules in the Faculty of Medicine and Dentistry and in the Faculty of Humanities and Social Sciences took part in the pilot.
549 unique students and 21 educators/ professional staff used Cadmus as an assessment tool. 1,406 student submissions were made.
The overall response was positive. Academic teams found Cadmus useful and insightful:
These positive indicators were accompanied by increases in both submission rates and student grades in comparison with 2022/23.
“Using a checklist really helps with organizing the content and layout.”
"I love the fact that Cadmus automatically saves my work. It’s almost like following a recipe, which definitely alleviates a lot of stress.”
By Students at QMUL
Academics who have been using the Cadmus platform say it has:
If you would like to know more about this project, or any of the other work taking place within the Digital Education Studio, please e-mail: digitaleducationstudio@qmul.ac.uk