The coronavirus disease 2019 (COVID-19) crisis posed new challenges in higher education, which compounded the existing challenges. The South African higher education sector responded with plans to secure the learning and teaching mandates and bolster support services for students. An emergency remote learning and teaching plan was launched to mitigate the impact of the pandemic in the 2020 academic year. This article reports on the reflections of lecturers who were teaching psychometric assessment and supervising student psychologists on the clinical master’s programme during the pandemic. The Master’s Clinical Psychology Programme at the University of the Western Cape was the case study. The focus on the psychological assessment module was the unit of analysis. Course documents and reflective notes, generated during the adaptation of psychological assessment training, were used as the data source. Thematic analysis generated five themes, namely, (1) the importance of statutory guidelines for clinical training, (2) adapting content, (3) pedagogy and modalities, (4) management of test libraries and (5) lecturer experience. The management of changes to the module in response to the COVID-19 crisis was challenging. Lecturers had to balance competency training and assessment with revised work and adapted teaching conditions. Emergency teaching interventions took place in the framework of ethics and professional requirement, and the learning outcomes articulated within the scope of practice for clinical psychologists.
Continuous changes in the academic landscape and student protests have been the realities of higher education in South Africa over the past two decades. The higher education sector is considered ‘high stress’ as functions are performed in a volatile, uncertain, complex and ambiguous environment (Simons, Munnik, Frantz, & Smith,
The University of the Western Cape (UWC) launched an emergency remote learning and teaching plan to curtail the impact of the pandemic on the 2020 academic year (Lawack,
During the lockdown, professional programmes prioritised the completion of theoretical components. With the advent of COVID-19, the guidelines for teaching psychometrics at higher institutions of learning and the minimum standards for training of clinical psychology published by the Board of Psychology (HPCSA,
The Professional Board for Psychology at the Health Professions Council of South Africa (HPCSA) and the Psychological Society of South Africa (PSYSSA) provided guidelines for the adoption and operationalisation of remote training in psychology. These guidelines encouraged institutions that engage in postgraduate training to provide trainees with reasonable clinical exposure as well as support during this time of national disaster (HPCSA,
Competency-based training in psychometric assessment included theory, practice and integration. The modes of delivery included face-to-face lectures, work-integrated learning and supervision. Under normal circumstances, changes to the modes of delivery were introduced systematically and gradually. Similarly, learning modalities, activities and platforms were selected to enhance the traditional face-to-face (contact) learning and teaching. The pandemic necessitated an emergency online teaching approach that focused on case-based learning supported by paper-based supervision and integration.
Clinical training in the second and third terms was directly impacted by the lockdown and the lack of access to the physical campus (Padmanabhanunni,
The aim of this article is to identify the adaptations to teaching of psychometric assessment during COVID-19. It reflects on the rationale and impact of the adaptation of the psychometric curriculum for master’s-level student psychologists at a South African University.
A case study design was used to describe and explore adaptation to psychological assessment teaching practices during COVID-19. The case study method helped to attain an in-depth appreciation of the adaptation to teaching (the issue) in response to COVID-19 (the phenomenon of interest) in its naturalistic, real-life context, that is, professional training at the identified university as recommended by Crowe et al. (
The research setting or case study site was UWC. The master’s programme in clinical psychology is housed in the Department of Psychology and the Faculty of Community and Health Sciences. The master’s training programme is a full-time training programme accredited by the HPCSA and leads to registration as a clinical psychologist (HPCSA,
The psychological assessment module was defined as the case. Successful completion of this module is a prerequisite for achieving the published professional competencies in psychological assessment (HPCSA,
Training in psychological assessment is a year-long module that included work-integrated learning, lectures, observation of assessments, simulations of test situations, case studies and testing in real time (Faculty of Community and Health Sciences,
The training team in psychometry consisted of four lecturers with PhD qualifications, who were appointed at the rank of senior lecturer (3) and associate professor (1). The lecturers were registered clinical psychologists for 17, 14, 11 and 10 years, respectively. Their teaching experience in higher education spanned 23, 12, 9 and 7 years, respectively. Their focused experience of 17, 12, 9 and 7 years, respectively, in teaching psychometrics in professional programmes led to their registration as counsellors (BPsych) and psychologists (M.A. Psychology). Their experience of clinical supervision along with psychometric assessment included 17, 12, 11 and 6 years, which were acquired in professional programmes spanning eight institutions and five internships. Thus, there was a breadth and depth of experience in this teaching cohort.
The training team for psychometry reports to the broader collective at monthly meetings. During the imposed early recess, the training team met more regularly to discuss adaptations and teaching strategies. Minutes of these meetings as well as reflective notes by the staff were compiled in order to track decision-making and dynamic aspects including, but not limited to, personal experiences and collective experiences of the adaptation process. Similarly, course outlines and guidelines for student participation and assessment were revised. All these course documents were compiled into an archive that is stored as evidence for accreditation, quality assurance and compliance purposes. The aim of the case study was to establish how COVID-19 affected the teaching and assessment practices of this module at UWC.
The archive of course documents comprised the source of data for this study. The use of records and documents can be limiting in terms of fit for purpose, completeness and robustness (Creswell,
Multiple sources of data such as revised course outlines that accommodated online teaching, revised assessment schedules, instructions to students about the proposed changes to the digital learning management system (iKamva) and lecturer reflections were considered to develop a holistic picture of the data pertaining to the case study. The use of multiple sources of data increased the trustworthiness of the study as recommended by Crowe et al. (
Thematic analysis was used for data analysis. Two reviewers immersed themselves into the data through repeated reading and viewing of all the sources. Data were organised and coded to allow key issues to emerge. Key issues were organised into themes. The data analysis followed the basic steps outlined by Creswell (
The data were produced as part of an educational quality assurance process. Secondary research constitutes low-risk research and does not require ethics clearance. No students were identified or no work produced by students were used. The data were generated by the authors as the lecturers involved in the quality assurance process. The lecturers consented to the use of the documents for the purposes of producing this manuscript. These documents are available in selected shared digital spaces. The potential benefits of this article include a contribution to the community of practice in professional training during the COVID-19 pandemic. The draft manuscript was presented to the Office of the Deputy Registrar at UWC to obtain permission for publishing an article in which the course documents were used and the institution is named. Through this process, the risks associated with reputational harm to third parties and the institution were mitigated or averted. Written permission for submission of the article was obtained as a letter of endorsement with reference number: UWCEN161020MS on 16 October 2020. Basic principles such as proper anonymisation of data were applied in the study. Only information related to teaching and supervision experience in higher education, placement and qualification were disclosed to provide context. This information is available in the public domain and in the register of the HPCSA. The lecturers consented to the content and the nature of information shared in the article.
The transition to online learning, focused on digitised teaching and learning methods, posed various challenges to achieve the bridging of theory and practice and mastery of clinical competencies. Five themes emerged, namely, (1) guidelines for clinical training, (2) adapting content, (3) pedagogy and modalities, (4) managing test libraries and (5) lecturer experience.
The training team reflected that the responsiveness demonstrated through the provision of revised guidelines was containing personally and facilitative at an operational level. The responsiveness of the professional bodies provided a framework that in turn promoted a common reference and sense of a community of practice. The teaching team could make decisions about adaptation to the curriculum within a clear framework that provided both security and direction during uncertain times.
There was variation in the ease with which content could be adapted for emergency remote teaching. This variation related to the nature of test contents as well as the structure of the tests.
Adapting teaching modes was easier for principles of test construction such as validity and reliability. Abstract constructs that underpin tests were more challenging. Theoretical and operational definitions were more readily translated for remote teaching. In contrast, the more nuanced, dimensional understanding of constructs demanded more engagement than the digital platform could afford. Such constructs were further illustrated using clinical examples that drew more heavily on the experience of the lecturer, as students were not exposed to clinical settings. The nature of the content intersected with the extent to which students had clinical references. The domains in cognitive assessment were challenging to teach. Personality assessment was less sensitive to issues of practice effects and teaching during measurement, creating greater flexibility in how the resource could be demonstrated to students.
Self-report measures, for example, structured personality assessments, use questionnaire test booklets with standardised instructions. Test booklets are available in hard copy or digital form. The structured nature of these tests shifts the emphasis of training onto scoring and interpretation of client profiles as administration is relatively uncomplicated and can be self-taught. Such tests allowed for independent work to become familiar with the test and administration. This provided a basis for teaching technical aspects like scoring and higher order aspects such as interpretation. The additional time available to focus on interpretation of structured measures appeared to mitigate the impact of remote teaching and the limited contact.
Projective tests required actual teaching of test administration and scoring to ensure that students understood the highly specified administration procedures and scoring systems in addition to the interpretation and online exposure to manifest the content of stimulus cards. In this instance, the online environment was secured to avoid the risk of violating the confidentiality of content through unauthorised auditing. Thick descriptions of manifest content were provided rather than visual stimuli as part of presentation slides or screen share functions. Teaching the administration and scoring of projective personality tests was done using anonymised protocols. Students were given completed protocols to practice scoring. The uniformity of protocols allowed for comparison between students and mastery was achieved through providing multiple cases to score. The number of completed scoring trials far exceeded the number of students who would have achieved through actual administration.
The teaching of cognitive measures in an online learning space was more challenging as it entailed mastery of complex administration and high-level interpretation. Cognitive and developmental measures require the test administrator’s familiarity with various novel test components. Students’ limited access to test material during lockdown substantially reduced the opportunity to familiarise themselves with the material. Logistic challenges included access to test materials and challenges of a conceptual nature such as how to teach students to effectively administer, score and interpret tests without face-to-face assessments. Ethical concerns in online teaching such as copyright for material used (digitisation or copying), the confidentiality and the security of test content posed threats during online teaching.
Live assessment was not feasible, given the social distancing and travel restrictions. The clinic on campus remained closed and physical access was only permitted to a selected number of students within the allowed 30% during the adjusted level 3, for example, access to science labs. Although online counselling services were available, no psychometric assessments were possible. Student psychologists (M1s) were not permitted to access the clinical platform and, therefore, could not visit hospital-based placements. Viable alternatives had to be found to provide experiential learning. Case studies effectively helped to develop clinical reasoning, selection of tests and compilation of batteries. Protocols from the departmental archive provided appropriate training cases that students could use to master scoring and interpretation in an online space without the risk of direct client contact. The remedial learning on administration will take place during internships (HPCSA,
Providing epistemological access to the complex nature of psychometric assessment remains a key challenge when teaching. The requirement of high level of technical and interpretive skills is challenging to all students regardless of the prior learning experiences and individual differences in ability. It is also important to hone the skills of observing and describing behaviour during testing in the context of assessment. The ability to read emotional cues during the physical assessment is key for the trainee psychologist to master. This learning was deferred to internship because of continued restrictions that made direct client contact difficult. Similarly, the teaching clinician has a reduced opportunity to use the emotional resonance in the classroom to assess and track students in terms of engagement, comprehension, emotive responses and reactivity to text content as well as the ability to learn and generalise acquired skills.
During remote teaching, students typically disable the video function on their devices in order to save bandwidth and maintain privacy. This further reduces the ability to assess students learning in live, albeit digital, settings. This in turn detracts from the ability to understand where students may struggle, where to provide further elaboration or general encouragement. The virtual classroom blunts this effect and contributes towards feelings of isolation.
The virtual classroom and online formats required additional consideration and actions in order to ensure a safe and ethically sound learning space. Staff had to manage the boundaries of online classrooms by setting passwords that were valid for restricted periods and creating defined participant lists. In this way, the risk of accidental access to confidential content and test material was reduced. Similarly, the end-to-end encryption on platforms maintained the confidentiality of the teaching space.
The online learning environment included a number of modalities. The advantages and disadvantages of each are outlined below.
Lecturers compiled slides under the pressure of time during early recess. The quick turnaround period to revise or prepare the slides in the required format was challenging and largely dependent on the level of technical skill in the teaching complement. Pre-recorded narrated presentations were supplemented with worksheet exercises and online question and answer sessions. Completion of the narrated slides did not equate to the confidence that the work was effectively covered to achieve learning, mastery and integration. Tracking students’ downloading of prescribed material and narrated slides did not sufficiently replace tracking engagement with the content. Narrated PowerPoint slides gave students flexibility to work through the material at their own time relative to the competing demands of studying from home. Data vulnerability and connectivity were obstacles to students’ ability to access and engage the material.
Applications such as WhatsApp provided a platform for contact between the staff and the students. Student queries, quick announcements and ‘checking in’ were easily facilitated via this platform in a data-light manner. It proved to be useful to foster open communication and greater access and connection with students. In this way, it created a community of practice with the flexibility to respond even whilst otherwise occupied, for example attending a meeting. This format required explicit boundary setting and underscoring professional use of the platform to make it fit for the purpose when connecting via personal devices.
Webinars presented as 90-min sessions were used as critical discussion forums after students worked through relevant content distributed through the secure online university learning management platform. These sessions facilitated ‘check-ins’ both to hear how students were doing and to identify the challenges in learning.
Video recordings of demonstrations of test administration were useful to offset the loss of contact sessions where demonstrations would have normally taken place. The recordings become resources that students can revisit if necessary. This contributed to deepened understanding and fostered learning. The management and regulation of access to such video materials were critical to ensure that the ethical obligation of keeping the content of test material confidential is met. Thus, the instruction in professional and ethical conduct had to be explicit, and measures are introduced to formalise the ethical obligations for students, for example a confidentiality binding agreement. Although these measures cannot guarantee that transgressions will not occur, it provides a clear account of ethical conduct in the teaching and instructional space, which confirms that the student was appropriately and properly informed. Such documented processes can be subsequently used in disciplinary processes.
Case studies provided an alternative to practical hands-on training during lockdown. Aspects like scoring, interpretation and report writing were facilitated through the use of case studies to integrate the various components of assessment. History taking, compilation of test batteries, observation of behaviour during testing and clinical reasoning required additional facilitation in order to develop mastery from case study methods. The former set of skills could be developed to a greater extent whilst the latter set of skills was achieved to a lesser extent than during the normal circumstances.
During the pandemic, the transition to online learning was an emergency measure implemented under the pressure of time with the possibility of contact being uncertain and unconfirmed. The pedagogy, teaching practices and assumptions underpinning the psychological assessment curriculum was re-examined, evaluated and adapted with formats and modes of delivery not typically associated with professional training in general and psychometric assessment in particular. The challenge was to ensure that adaptations resulted in an inclusive learning experience. The resultant curriculum of necessity had to be dynamic, responsive to changing demands and sensitive to contextual realities of students in South Africa. Contextual challenges such as load shedding, unequitable access to data and devices, socio-economic challenges and the extent to which home environments were conducive to living and learning, increased family responsibilities during lockdown and stereotypical gender roles and division of labour had to be considered.
Professional training in psychometry requires access to a secure and well-managed test library. As mentioned before, the Psychology Department at UWC has a well-curated test library that ensures access to current test material, despite the resource constraints associated with a historically disadvantaged institution.
As described earlier, the breadth and depth of experience in the training collective was substantial. Lecturers were able to draw on their teaching, supervisory and clinical experience to offset limitations in the current teaching context. The ability to provide real-life clinical references assisted students to develop a more nuanced understanding of key constructs in assessment. The depth in teaching experience across programmes and institutions provided a strong base from which to move into adaptation. Thus, the confidence in the content and a clear understanding of the learning outcomes and competencies that had to be mastered meant that more attention could be focused on finding alternate modes of teaching and creating space for reflective practice. The depth of experience in supervision of psychometric assessment articulated into a good understanding of how to work developmentally and to facilitate the learning needs of students. In the adaptation process, this experience was important as it provided a framework and a reference for decision-making about which aspects to prioritise and which aspects to defer. The breadth and depth of experience was as important as the intentional reflexive practice in the programme, which meant that the training team was able to access the experience and had the disposition to want to access it.
The COVID-19 pandemic necessitated emergency responses from the higher education sector in order to ensure business continuity and the completion of the 2020 academic year. In the context of professional programmes, such as clinical psychology, adaptations and accommodations had to make educational sense and satisfy professional competency and statutory requirements. The pandemic challenged the pedagogy and learning principles, underpinning professional training in psychometric assessment. Course adaptations had to be contextually appropriate considering the physical, emotional, social and financial barriers students would potentially face during COVID-19. The findings identified that the ability to be responsive and make meaningful changes was in part facilitated by clear frameworks from the professional bodies. The professional bodies provided an adapted statutory framework that guided curriculum changes in psychometric assessment. Decisions about adaptations to curriculum were taken within this adapted framework. Careful, albeit pressured, considerations of the learning outcomes and competency requirements assisted in the identification and implementation of realistic amendments to the curriculum within the broader competency framework provided by professional bodies. This was consistent with the literature on curriculum adaptation and re-curriculisation (Barab & Luehmann,
The findings indicated that the conceptualisation of professional training as a process involving different phases and stakeholders promoted responsiveness. Such a conceptualisation allowed the training team to identify the skills that could be deferred to internship. The training in the first year of the programme could then prioritise mastery of theoretical concepts and baseline clinical competencies that were deemed essential for the completion of first year clinical training in psychometry and progression to internship. In this way, the training could ensure that adapted learning outcomes and competency requirements were attained. This resonates with the HPCSA’s policy regarding intern psychologists, guidelines for universities, internships, training institutions and intern psychologists (
The literature indicated that universities with the existing ICT infrastructure and learning management systems were able to migrate faster to emergency remote teaching using digital platforms (Almaiah, Al-Khasawneh, & Althunibat,
This study demonstrated that the responsiveness of institutions was influenced by their governance structures. The identified institution was able to provide flexible governance and decisive leadership in academic planning and quality (UWC,
The findings illustrated that adaptation to teaching practices and modes of learning was linked to the type of assessment measure and the nature of the content. Theoretical concepts, psychometric properties and self-administered measures were easily taught. It required less focused instruction in and practice of administration that in turn freed up time to focus on scoring, interpreting and report writing. Projective personality tests, cognitive and developmental measures required explicit instruction in administration in addition to scoring, interpreting and report writing. Immersion in real-life assessments was not possible, and the requisite skills were taught through case-based learning. The availability of a well-curated archive of developmentally appropriate cases including original protocols assisted the shift to case-based learning. Similarly, the creative use of instructional videos, narrated slides, simulation and digital classrooms were useful to teach assessment. Teaching in a collective also provided a community of practice and sound boarding that reduced the isolation of teaching in this context. The depth in the experience of the teaching staff in psychometric assessment and clinical supervision contributed to the readiness and capacity to be adaptive. Reflexive practice and team-based training positively influenced the process of curriculum adaptation.
Teaching psychometric assessment during the pandemic necessitated additional considerations in the ethical management of test materials. The findings illustrated the importance of regulating the use of test content and materials in slide presentations (HPCSA,
One of the key limitations of the study is that it focused on one of the three professional programmes in psychology offered at the institution, despite the rationale provided for the decision. The study does not include student reflections and thus is limited in terms of the insights into the subjective experiences of students of this revised programme. Similarly, the article and study focused on the operational and pedagogical issues experienced by staff whilst not addressing the subjective experience of working through re-conceptualisation. The demographic information of the lecturers involved was not provided in order to protect identities, and it was not considered important for the collective-level data. In this way, some of the dynamic information about the relative position of the lecturers in the collective is lost to analysis. Such an analysis, although useful, was outside the scope of what this manuscript set out to do.
The present case study is reflective of the many challenges and considerations that COVID-19 posed and necessitated in the training of clinical psychologists in psychometric assessment at higher education institutions. It demonstrates how learning and teaching were adapted and re-aligned within the framework of statutory and professional requirements to facilitate a digital online environment for students to still attain professional competency in psychological assessment.
The authors declare that they have no financial or personal relationships that may have inappropriately influenced them in writing this article.
E.M. and M.S. participated in the conceptualisation, design, composition of the study and writing of the manuscript. All the authors participated in the reflections, preparation and critical revision of the manuscript.
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
The source of data was confidential course documents that are not available for public distribution.
This research has not been commissioned nor does it represent any affiliated agency of the authors.
Historically disadvantaged institutions refer to institutions in South Africa created under apartheid to cater to Africans and the mixed race.