Validation of the professional self-identity questionnaire for medical students during clinical practice in Japan

This is an Open Access article distributed under the terms of the Creative Commons Attribution License which permits unrestricted use of work provided the original work is properly cited. http://creativecommons.org/licenses/by/3.0/

Abstract

Objectives

To validate the Professional Self Identity Questionnaire (PSIQ) for medical students during clinical practice.

Methods

We conducted a single-year longitudinal questionnaire study using the PSIQ. The PSIQ rates the nine items of "teamwork", "communication", "conducting assessment", "cultural awareness", "ethical awareness", "using records", "dealing with emergencies", "reflection", and "teaching" on a scale of 1-7 points. The study participants consisted of 118 fifth- and sixth-grade medical students who completed a mandatory 4-week clinical practice in a community-based medical education (CBME) curriculum. The data were collected before and after the CBME curriculum and after clinical practice at the time of graduation. To validate the internal structure of the PSIQ, we calculated Cronbach's alpha in the three phases. Additionally, to assess construct validity, we analyzed the trends and differences in each of the nine items of the PSIQ using repeated measures analysis of variance (ANOVA). We also showed the differences in effect size before and after the CBME curriculum.

Results

The data of 105 medical students were analyzed. Cronbach's alpha in the three phases was 0.932, 0.936, and 0.939, respectively. PSIQ scores increased progressively for all items, and the F-test for repeated measures ANOVA of nine items' average score across the three phases showed a significant difference F(2,208) = 63.59, p

Conclusions

We validated the PSIQ for medical students during clinical practice. Reflecting on professional identity may provide an opportunity for meaningful feedback on readiness to become a doctor.

Keywords: Professional identity, community-based medical education, curriculum evaluation, clinical-clerkship, cultural responsiveness, Japan

Introduction

Professional identity is a 'state of mind' – namely, the identification of oneself as a member of a professional group. 1 It is defined as "the attitudes, values, knowledge, beliefs and skills shared with others within a professional group". 2 The development of professional identity has been described as an ongoing process which is influenced by several factors, including clinical experience and professional socialization. 3 In the last two decades, in accompaniment with advances in medical genetics and other technologies, healthcare providers have increasingly had to deal with complex ethical issues in which medical knowledge alone is not enough; examples include newly arising infectious diseases, socioeconomic problems and the aging population. 4 In this context, the need for professionalism by individual physicians is growing. In medical education, the aim of professionalism education has expanded to include the development of professional identity. 5

In undergraduate medical education, professional identity is influenced by various aspects of the university curriculum. 6 - 8 The development of professional identity plays an important role in promoting students' sense of responsibility and in defining themselves within their professional role. 9 In particular, the professional identity of medical students during clinical practice changes dynamically as their identities are constructed and deconstructed through multiple departmental rotations. 10 For medical students, professional identity is impacted by any and all of experiential learning, early clinical experience, role models, dialogues, socialization, and relationships between physicians and other healthcare professions. 7 , 11 , 12 Students' behavior as healthcare providers is also influenced by the opportunity to engage in meaningful interaction with and provide constructive feedback to multiple healthcare professionals. 7

Within the clinical practice, the community-based medical education (CBME) curriculum creates the opportunity to formulate such a professional identity. 13 One important reason for this is that the students typically find themselves in smaller groups in their CBME rotation than in other clinical practice rotations, which provides greater opportunity to both converse with and develop close relationships with supervising physicians and multi-healthcare professionals, and to learn cross-cultural community needs. 14 In CBME, medical students experience different aspects of professional competencies, such as cultural awareness. 15 Through these experiences, students encounter patients and issues in the context of their lives and localities and benefit from experiential learning through their involvement in patient care. 16 - 18 To date, however, few validated questionnaires have been developed to assess professional identity formation during clinical practice, including CBME. 15

In this study, we focused on the Professional Self Identity Questionnaire (PSIQ). Originally developed to measure professional identity in the healthcare professions, 1 the PSIQ has been used for medical and other students and can also be used to evaluate professional identity in multiple professions. It assesses nine professional identity items in a multifaceted manner and is easy to use at any level. 19 , 20 Here, we aimed to validate the PSIQ to measure professional identity formation in medical students during clinical practice, including CBME.

Methods

Study design and participants

This longitudinal questionnaire study was conducted to test the validity of the PSIQ. The study participants consisted of 118 fifth- and sixth-grade medical students who completed a mandatory 4-week clinical practice in the CBME curriculum between September 2018 and May 2019. We explained to the students that this survey would be conducted as program evaluation and research and that their grades would not be affected if they did not agree to participate. This study was approved by the Ethics Committee of the Faculty of Medicine, the University of Tsukuba (No. 1329).

Data collection method

The PSIQ includes nine inventory items, namely "teamwork", "communication", "conducting assessment", "cultural awareness", "ethical awareness", "using records", "dealing with emergencies", "reflection", and "teaching". 1 Each item is rated on a 7-point Likert scale. Through engagement with each of its nine items of professional activity, this instrument measures the sense of students in identifying their current position on a continuum between 'first-day student' and 'qualified doctor'. For this research, we set 1 point as "equivalent to the first day of clinical practice" and 7 points as "equivalent to the first day of initial residency". The original study was validated in a sample of 496 medical students across multiple phases of education and had a reported overall internal reliability (Cronbach's alpha) of 0.93. 1 In our present study, two researchers (JH and SO) independently translated the English language version of the PSIQ into Japanese. Three other authors (TM, AH, TM) then finalized the content and comprehensibility to produce a Japanese version.

Setting

First, we describe aspects of medical education in Japan, which in context may have influenced our findings. 21 , 22 In Japan, eligibility to enter medical school is assessed in high school graduates. The standard undergraduate medical education program is six years. Typically, the initial phase of undergraduate medical education contains, to varying degrees, general education in subjects such as biology, chemistry, physics, and mathematics, as well as a wide range of liberal arts subjects. In parallel with the liberal arts, medical students study basic medicine for 1-2 years, followed by pre-clinical education for 1-2 years. Medical students must pass the CBT (Computer-based testing) and Pre-OSCE (Objective Structured Clinical Examination) exams prior to clinical practice to earn the title "Student doctor". After this, from the fourth or fifth grade of medical school, they spend one to one and a half years in a university hospital or community hospital or clinic in a community in small groups of 4-5 students. After a two-year clinical practice, they must pass their University's graduation exam and the post-clinical-clerkship OSCE to qualify for graduation, and then pass the annual national medical examination. The academic year starts on April 1 and ends on March 31.

Second, we focused on clinical practice at the University in this study. Clinical practice at the University is implemented from October in Year 4 to June in Year 6, for a total of 78 weeks, which made it the second-longest among Japanese medical schools at that time. This clerkship program is a part of the mandatory 4-week CBME (Community-based Medical Education) curriculum, which is conducted from October in the second half of Year 5 to May in Year 6. In clinical practice, the 4-week CBME curriculum is an essential component of education for medical professionals at the University. The 6-year pre-graduate curriculum provides students with the essential foundational competence required of all medical professionals, including medical ethics, primary care, health promotion, professionalism, and interprofessional collaboration. The CBME curriculum is the clinical practice component of this essential knowledge for medical professionals.

The CBME curriculum aims to help students: 1) understand the expertise of family physicians, who provide appropriate medical care in various clinical settings; 2) understand the health issues of citizens, patients, and families from the perspective of the local healthcare system; and 3) acquire clinical reasoning skills.

Every four weeks, 15 to 17 students participate in the rotation. The students are divided into four groups of four or five people. They rotate through specific clinics and/or small hospitals in community-based settings and/or the central community hospital in each region, but not all locations in the region. Some groups of students participate in "community diagnosis" as a part of their CBME, in which they aim to provide a quantitative and qualitative description of the health of local citizens and the factors which influence their health. In this process, students collect quantitative and qualitative data concerning X hospital and/or Y clinic in different regions through windshield surveys, including observations made from a moving vehicle, interviews with local residents, and retrieval of local data in public repositories. All students also spend one week in the family medicine department of a university hospital. All settings are located in suburban or rural areas of Ibaraki Prefecture, Japan. The first and last days of the 4-week curriculum include meeting at the university hospital for orientation and reflection. During the rotation, students experience outpatient medical interviews and reflection; participate in-home visits for medical and nursing care; provide health promotion classes to citizens or elementary or junior high school students; and experience community diagnosis in various settings. The curriculum is organized by faculty members of the Department of Family Medicine at the University of School of Medicine and Health Science and is supported by physicians and other healthcare professionals, and local citizens in the community. The students are evaluated based on their performance in each setting and the final reflective report they write and submit on the final summary day.

Procedure

To assess the construct validity of the developed PSIQ over time, a PSIQ survey was conducted in the pre-CBME curriculum (phase 1; before CBME on the first day of the program), post-CBME curriculum (phase 2; after CBME on the last day of the program), and delayed post-CBME curriculum (phase 3; at the time of graduation in January 2020) ( Figure 1 ).