Skip to content
Teaching and Education Research

An international forum for rigorous research on teaching, learning and teacher education

Research articleOpen access

Longitudinal effects of a scenario-based learning intervention on preservice teacher self-efficacy

Show affiliations and correspondence
  1. aUNSW Sydney
  2. bUniversity of Oxford
  3. cUniversity of Vienna
  4. dJustus-Liebig-Universität Gießen

DOI: https://doi.org/10.1016/j.tate.2024.104859

Outline

Abstract

We explore how an online ‘scenario-based learning’ (SBL) intervention is associated with the teaching-related self-efficacy of 1261 preservice teachers recruited from an initial teacher education (ITE) program in the UK. Participants completed four 1-hour online sessions involving realistic classroom scenarios and received real-time feedback on their responses. Results showed a positive upward trajectory for self-efficacy with some variation among the self-efficacy subdomains. Results from open-ended responses following the intervention showed how reflection on scenarios and feedback played a role in preservice teachers' self-efficacy. The findings highlight the benefits of providing preservice teachers with low-risk, authentic classroom experiences bolstered by expert feedback and opportunities for reflection. • Preservice teachers' self-efficacy is dynamic. • A scenario-based learning intervention increased teaching self-efficacy. • Self-efficacy beliefs vary according to self-efficacy sub-domain. • Reflection and feedback influenced confidence for teaching.

1. Introduction

For preservice teachers, the field-based teaching placement represents a critical transformational phase of initial teacher education (ITE; Anderson & Stillman, 2013). How well a preservice teacher navigates the placement influences future career opportunities and intentions (Krieg et al., 2021), but also has an impact on the pupils being taught and on the reputation of the ITE program represented by the preservice teacher. Teaching placements provide preservice teachers with the opportunity to build their teaching self-efficacy (domain-specific confidence), competence (skills and knowledge), and what Shulman (1987), and more recently, Loughran (2019), call pedagogical reasoning (i.e., the thinking that informs professional practice) in a close approximation of professional practice.

Pedagogical reasoning refers to the unseen aspects of teaching practice and brings to the foreground the ‘whys’ of in-context teaching decisions (Shulman, 1987). This specialized form of reasoning is developed when teachers engage with possible solutions to a wide range of pedagogical problems, and is sharpened through interactions with experienced colleagues (Loughran, 2019). ITE programs around the world strive to ensure that preservice teachers entering the classroom as teachers for the first time are well-prepared and confident to develop their pedagogical reasoning, and ready to address a host of pedagogical and personal challenges. Teacher education programs can prepare preservice teachers for initial teaching placements by providing activities that deliver authentic and challenging classroom scenarios that stimulate pedagogical reasoning.

We designed an online ‘scenario-based learning’ (SBL) intervention that presents preservice teachers with a series of brief videoand text teaching scenarios, an opportunity for self-reflection, and tailored feedback from experienced teachers. The classroom scenarios for the SBL intervention were co-developed with practicing teachers and teacher educators based on their own classroom practice and experience mentoring preservice teachers. Similar to Grossman et al.’s description of approximation of practice (2009), SBL involves encouraging preservice teachers to take on the “role and persona” of a teacher, while providing feedback on their efforts and decision-making (Grossman, 2009, p. 283). In this study we incorporate videoand text-based approximations of practice through provision of a four-session SBL intervention aimed to build the self-efficacy and pedagogical reasoning of preservice teachers preparing for teaching ☆ This research was supported by the European Research Council (Consolidator grant number 647234).

Additional support for the preparation of the article was provided by the Economic and Social Research Council (grant number ES/X002144/1). * Corresponding author. Department of Education, University of Oxford, 15 Norham Gardens, OX2 6PY. UK.

1. Co-first authors

placements.

1.1. Preparing preservice teachers for teaching placements

For many preservice teachers, the teaching placement represents the first exposure to professional practice, with research showing that performance during the placement is associated with effectiveness as a practicing teacher (e.g., Krieg et al., 2021). One key to success in teaching placements is preparing preservice teachers to apply their knowledge and thinking to the challenges that arise throughout the teaching day. Preparation for teaching placements is not only about building knowledge and skills, but about situated learning that recognizes the complexity and nuance of classroom context (Anderson & Stillman, 2012). Teaching placements are rated as among the most psychologically demanding experiences of ITE (Chaplain, 2008): strategic and impactful preparation is needed to boost preservice teachers’ confidence and readiness to succeed in the transformation from student to teacher.

A key aspect of preparing preservice teachers for teaching placements is ensuring that they feel prepared and confident to face the challenges that they will encounter when they enter the classroom. Interventions designed to build preservice teachers’ teaching-related self-efficacy can lead to successful experiences in the teaching placement (Brown et al., 2015).

1.2. Teachers’ self-efficacy

The current research is grounded in our understanding of selfefficacy, defined as beliefs in one’s capabilities to carry out the courses of action required to achieve desired outcomes (Bandura, 1997). Based in the broader framework of social cognitive theory, self-efficacy has been shown in a wide range of contexts to play a role in influencing how an individual navigates through life’s challenges. Bandura proposes four sources of self-efficacy: enactive experiences, vicarious experience (i.e., observing successful others), verbal persuasion (feedback), and interpretation of physiological states, each of which contributes to an individual’s beliefs in their capabilities to succeed in an endeavour.

The four sources of self-efficacy are ‘activated’ through cognitive processing, i.e., through self-reflection on self-efficacy sources and their salience in a particular context. Navigating new challenges draws heavily on one’s self-efficacy beliefs, and these beliefs are especially important when individuals face new vocational experiences. Bandura noted that “when facing new occupational role requirements, adaptation is a … complex process of self-development” (1997, p. 30), with self-efficacy beliefs playing a prominent role in vocational development. For preservice teachers, the developmental challenge of transitioning from student to teacher demands not only specific knowledge and skills, but the confidence with which to implement them.

Teachers’ self-efficacy—domain-specific beliefs teachers hold that they can positively influence student learning—has received considerable research attention in the last two decades, with research showing that the level of teaching-related self-efficacy is significantly and positively associated with classroom effectiveness (Klassen & Tze, 2014). Furthermore, teachers’ self-efficacy has been shown to counteract negative emotions experienced during teaching placements (Hascher & Hagenauer, 2016), and is linked with novice teachers’ retention in, and commitment to, the profession (Chesnut & Burley, 2015). Preservice teachers’ self-efficacy is dynamic and influenced by positive enactive and vicarious experience and constructive feedback, particularly due to their limited experience in the field (Pfitzner-Eden, 2016).

While some efforts have been made to investigate how preservice teachers’ self-efficacy may change during ITE, research in this area has primarily focused on monitoring change during teaching placements (Klassen & Durksen, 2014; Berg & Smith, 2018), and much of this research has relied on research designs with only two measurement points (e.g., Berg & Smith, 2018), meaning that the shape of change over time is not detectable. Teachers’ self-efficacy has been shown to fluctuate over time (Zee & Koomen, 2016), and not always in a linear fashion (Klassen & Chiu, 2010), meaning that multi-wave longitudinal designs can provide greater insight into temporal patterns of change during important phases of teacher development.

Although teachers’ self-efficacy is hypothesized to have a universally relevant effect on teaching behaviors that transcends demographic factors (e.g., culture, sex, age), there are documented differences in levels of self-efficacy across demographic categories. For example, males and majority ethnic groups have reported higher levels of self-efficacy than females and minority ethnic groups (e.g., Huang, 2012), although findings vary across domains and ethnic groups (Sheu et al., 2018). Recent research by Sackler et al. (2021) showed that teachers’ self-efficacy operates in similar ways across cultural groups, although there were variations across groups in some efficacy domains. Similarly, age plays a role in the self-efficacy of teachers, with Klassen & Chiu, 2010 showing growth and then decline over age groups and career stages.

Using U.S.-based data from the 2018 Teaching and Learning International Survey, Yoon and Kim (2022) found differences in teachers’ self-efficacy profiles by sex and experience, concluding that demographic characteristics play a role in influencing self-efficacy beliefs. Mok et al. (2023) proposed that building self-efficacy during teacher education programs and teaching placements is crucial to support preservice teachers’ teaching-related skills and practice. Therefore, interventions designed to boost the self-efficacy of aspiring teachers should be tested to determine their effectiveness across demographic groups. Research exploring preservice teachers’ experiences in teaching placements provides clues to mechanisms for ways to boost self-efficacy.

The teaching placement involves potential exposure to the four sources of self-efficacy through practical experience in context (i.e., mastery experiences), observing how qualified teachers approach challenging classroom situations (i.e., vicarious experiences), feedback and verbal persuasion (e.g., from mentors), and a range of affective states (Pfitzner-Eden, 2016). Ma et al. (2022) noted two factors that may lead to increases in preservice teachers’ self-efficacy: first, provision of a protective environment incorporating feedback from experienced teachers, and second, exposure to authentic teaching experiences including role-playing activities. Similarly, Brown et al. (2021) highlighted the importance of expert feedback and authentic teaching experiences in preparing preservice teachers for the classroom.

However, the quality and value of experiences can vary between teaching placements (Darling-Hammond, 2020), with preservice teachers’ interpretation of these experiences positively, or negatively, influencing teaching self-efficacy beliefs (Pfitzner-Eden, 2016). Although there is little debate about the importance of providing actual teaching experience in well-supported ‘live’ classroom settings, if preservice teachers do not feel confident and prepared prior to placements this may have a detrimental impact on their experiences and teaching confidence (Lindqvist et al., 2017). Therefore, the provision of simulated teaching experiences that provide opportunities to reflect and receive feedback on complex teaching situations and include components informed by the sources of self-efficacy beliefs may serve as a useful complement to conventional teaching placement experiences.

1.3. Scenario-based learning interventions

Scenario-based learning (SBL) is an online intervention that provides participants with a situated learning experience (Lave & Wenger, 1991) in which learning is engendered through the interactions of person, activity, and context. In the case of SBL, the aspiring teacher considers an authentic and contextualized classroom scenario, and subsequently engages with feedback from more experienced teachers in a supported, low-risk setting. The scenarios in SBL can target specific domains; in this study, the four SBL domains chosen in collaboration with our teacher educator partners included managing student behavior, adapting teaching to meet all student needs, time management, and working J.V. Rushby et al.

closely with colleagues, which have been found to be challenging for early career teachers (e.g., Watzke, 2007). Theories underpinning SBL interventions (social cognitive theory, Bandura, 1997; situated learning theory, Lave & Wenger, 1991; pedagogical reasoning, Loughran, 2019) suggest that pedagogical knowledge and reasoning develop through the interaction of knowledge, experience, and context. Sometimes known as ‘case-based learning’ or ‘near-world simulations’ (Errington, 2011), SBL provides participants with the opportunity to reflect on their pedagogical knowledge, and to enact that knowledge in authentic simulated classroom contexts. Research on a single-session SBL intervention has shown increases in preservice teachers’ perceived confidence and readiness to enter initial teaching placements, with feedback from participants indicating highly favorable reactions to the intervention, with over two-thirds of participants stating that they felt ‘more confident’ about starting a teaching placement after completing the intervention, and nearly three-quarters stating they felt ‘more prepared’ to begin their first teaching placement (Bardach et al., 2020).

SBL interventions for beginning teachers can be designed to feed into at least three of Bandura’s four sources of self-efficacy (1997). First, SBL provides enactive experience through participants’ engagement in authentic classroom challenges which require reflection on possible courses of action. Second, SBL provides some elements of vicarious experience or modelling through detailed guidance on the decisionmaking of experienced teachers (e.g., You’ve rated this response as appropriate. Experienced teachers rated this as inappropriate. A key challenge many teachers encounter is how to … Here are some suggested strategies from experienced teachers …). Third, SBL can provide verbal persuasion through messaging about response alignment (e.g., Fantastic!

The majority of your responses to the classroom scenarios were the same or similar to how experienced teachers suggested they would approach these situations). Providing simulations of teaching activities to preservice teachers allows for safe and guided early teaching experiences, with opportunity for reflection and growth, and the opportunity to build preservice teacher learning at the earliest stage of professional development (Mikeska et al., 2022).

1.4. Current study

Preservice teachers with robust teaching self-efficacy are more likely to experience success during teaching placements and express higher commitment to the profession (e.g., Chesnut & Burley, 2015). Building and testing scalable online teaching interventions that boost teachers’ self-efficacy has the potential to contribute to the preparation and readiness of preservice teachers before and during teaching placements and during early career teaching. In this study, we build on previous work that focused on the development and testing of single-session SBL interventions (Bardach et al., 2021; Klassen et al., 2021) by using a short-term longitudinal design2 to test the effects of a four-session SBL intervention on preservice teachers’ self-efficacy beliefs.

Research Question 1. (RQ1): What is the pattern of change in preservice teachers’ overall self-efficacy over four SBL sessions? Based on Bandura’s social cognitive theory, we hypothesize that exposure to authentic experiences, coupled with feedback, modelling, and reflection, will result in increases in preservice teachers’ overall teaching selfefficacy. Research Question 2. (RQ2): What are the differences in the starting points and trajectories of change for participants identifying as female and male? Based on conflicting data on gender differences in selfefficacy levels and patterns (e.g., Huang, 2012; Sheu et al., 2018), we make no directional hypothesis associated with RQ2. Research Question 3. (RQ3): What is the pattern of change in preservice teachers’ domain-specific self-efficacy beliefs?

Based on prior research into self-efficacy development by task (e.g., Chan, 2008; Klassen & Chiu, 2010; Skaalvik & Skaalvik, 2007), we anticipate that changes in self-efficacy beliefs may vary in relation to specific domains of teaching. Research Question 4. (RQ4): What are the differences in the starting points and trajectories of change for students from majority and minority ethnic backgrounds? Based on conflicting data on ethnic differences in self-efficacy levels and patterns (e.g., Sheu et al., 2018), we make no directional hypothesis associated with RQ4. Research Question 5. (RQ5): What are participants’ perceptions of the role of self-reflection and teacher feedback in relation to classroom scenarios on their teaching confidence?

Based on previous research on single-session interventions (e.g., Bardach et al., 2020), we hypothesized that participants would report a positive effect of self-reflection and teacher feedback on their preparedness for teaching.

2. Method

This study tested the patterns of change in overall and domainspecific self-efficacy associated with the delivery of a four-session scenario-based learning intervention delivered to preservice teachers over a six-week period. Participants could only access each session in the week in which it was released (i.e., they could not complete all sessions in a single sitting or in a single week). The short-term longitudinal design included self-efficacy measured at five points: a pre-test followed by four post-tests that were delivered after each SBL session in the intervention.

2.1. Participants

Data for this study were collected from 1305 secondary-level preservice teachers enrolled in a one-year, post-graduate ITE program that attracts applicants from all regions of England and Wales. We identified and contacted this ITE program for involvement in this study due to its stated focus on recruiting a diverse and nationally representative cohort of preservice teachers every year. During the period of the SBL intervention, which took place in the first two months of the ITE programme, participants in the ITE programme spent five days of observation in a school, attended in-programme teaching on effective pedagogy, and attended group discussions on a range of topics (e.g., creating a positive classroom environment, developing pupils’ intrinsic motivation, and addressing low-level disruption).

The SBL intervention was a compulsory component of the ITE program—termed a ‘hurdle requirement’—meaning that participation was mandatory, but not graded. However, participants’ agreement for the use of the data for research purposes was voluntary; 44 participants did not provide their consent for their data to be used for research purposes, resulting in a final sample of 1261 preservice teachers (65% identifying as female, 34% as male, 1% as other). The mean age of participants was 24.63 years (SD = 5.01). A total of 80% of participants identified as white British (majority ethnic group in subsequent analyses), 10% as Asian and/or Asian British, 4% as Black and/or Black British, and 6% identified as multiple or other ethnic groups (minority ethnic group).

2.2. Materials

2.2.1. SBL materials

The classroom scenario content was developed using a critical incidents approach (e.g., Buyse & Lievens, 2011) in which researchers conducted 1:1 and focus group interviews with experienced teachers who were asked to describe critical incidents faced by novice teachers

2. We acknowledge that longitudinal designs often involve extended periods

of time, sometimes over several years. In this study we use the term ‘short-term longitudinal design’ to refer to repeated observations of participants over the period of a few weeks. and the various ways (positive and negative) that these teachers responded. The scenario development process involved (a) identifying the target domains for the scenarios, (b) developing and revising the scenario content, and (c) establishing the scoring key through concordance panels with experienced teachers. Please see Durksen & Klassen, 2018; Bardach et al., 2020 for a detailed description of the process. The content of the feedback delivered to participants for each scenario was created through workshops with experienced educators (defined as having more than five years of teaching experience and experience supervising preservice teachers).

The scenario and feedback content followed the same development process described by Klassen et al. (2021) and Bardach et al. (2021). Twenty-four scenarios were arranged into four themed sessions, each including six scenarios. The session themes included (a) managing behavior, (b) adapting teaching, (c) time management, and (d) working with colleagues. For each scenario, participants were invited to (a) watch a brief animated video or read a text-based classroom scenario, (b) score the appropriateness of a set of three response options, with ratings of (1) inappropriate to (4) appropriate, based on what a beginning teacher working in a school should do; (c) provide a brief personal reflection on their ratings for each of the response options; and then (d) receive real-time tailored feedback from experienced teachers based on the level of alignment between their responses and the experienced teachers’ responses (see Fig. 1 for example of an SBL item).

The feedback from the experienced teachers for each response option included (a) an indication of participants’ alignment with the experienced teachers’ ratings for the response option (e.g., Experienced teachers agree! As you suggest, this response would be inappropriate); (b) the experienced teachers’ reasoning and the factors considered in the specific situation (e.g., Responding to the situation in this way is confrontational and may lead to an escalation of poor behaviour from the students. This would then impact negatively on the learning of the other students in the class. It may also create a poor relationship with the two students who may then disengage from learning in your lesson); (c) alternative strategies that may be more appropriate in the circumstances (e.g., It may be a better strategy to stop the lesson briefly and tell the two students to pay attention); (d) the reason why these strategies may be more effective (e.g., This makes it clear that you are aware they are talking and that you are not happy with their behaviour), and (e) how to implement the suggested strategies in practice and their potential benefits (e.g., It is important that you use a firm, but not aggressive, tone of voice.

Avoid engaging in conversation with them and continue with the lesson immediately after you have called them out as this shifts the focus of the lesson back to the learning with a minimal amount of fuss and disruption. It also sends a clear message to the rest of the class about your behaviour expectations). At the end of each session, participants received a feedback report based on the alignment of their scoring and the proposed scoring from experienced teachers accompanied by a summary of teaching strategies designed to further develop teaching competencies. The session report included background about the intervention, a summary of the session theme (e.g., behavior management), and a tailored message based on the level of alignment of participant’s responses with those from experienced teachers (e.g., Great!

Many of your responses were similar to how experienced teachers suggested they would approach these situations …). The session report concluded with suggested strategies addressing the session theme. Upon completion of all four sessions, participants received a concluding feedback report that included further resources addressing the four themes and an online certificate of completion. The scoring template for the scenarios (i.e., ratings of appropriateness for the response options) was set by experienced educators during the content development process. The score for each classroom scenario response was based on the distance-measure approach outlined by Patterson et al. (2013) which allocates points depending on the distance of participants’ scores from the expert-determined scoring key.

Using a similar approach to that of Bardach et al. (2021), participants were awarded five points for direct alignment, three points for one position away, one point for two positions away, and zero points for three positions away from the expert-determined best response. Scores for each session were used to provide tailored real-time feedback to participants based on their scoring alignment; however, actual scores were not presented to participants. The maximum score for each session was 90 (6 scenarios x 3 response options x 5 maximum points), and the maximum score for all four sessions was 360. In addition, participants were asked to provide an optional comment at the end of the four sessions on whether and how the intervention contributed to readiness to begin the teaching placement (Following the completion of this scenario-based learning module, do you feel more prepared to begin teaching? [YES/NO/UNSURE].

Please explain why or why not).

2.2.2. Self-efficacy measure

Teacher self-efficacy was measured using 11 items, with 10 items adapted from the Norwegian Teacher Self-Efficacy Scale (NTSES; Skaalvik & Skaalvik, 2007) and 1 additional item developed for this study. The adaptation of the NTSES included a change of wording in the stem (based on advice from Bandura [1997], from How certain are you … ? to How confident are you … ?) We also chose items for each domain with high factor loadings in the original NTSES. Participants were asked to indicate how confident they were in relation to four domains: (a) adapting instruction to individual students’ needs (three items; e.g., provide realistic challenge for all students); (b) maintaining discipline (two items; e.g., help students with behavioral problems to follow class rules); (c) cooperating with colleagues and parents (two items; e.g., cooperate effectively and constructively with other teachers); and (d) motivating students (three items; e.g., motivate students who show low interest in schoolwork).

An additional self-developed item measured participants’ perceived confidence to succeed in their upcoming ITE program. Items were rated on a 6-point Likert scale from (1) Not confident at all to (6) Very confident. Participants completed these items on five occasions (i.e., a pre-test before session 1 and four post-test measurement points).

2.3. Procedure

Participants completed four 1-h SBL sessions delivered within a sixweek window. Each session contained six brief, realistic, textor videobased classroom/school scenarios that were based on professional challenges that beginning teachers encounter in the classroom (e.g., Miulescu, 2020). The themes of the four SBL sessions included (1) creating a positive classroom culture, (2) managing behavior and differentiating the curriculum for all students, (3) organization and managing workload, (4) and communicating with parents and colleagues. Participants were asked to complete one SBL session each week in their own time on a device of their choice (i.e., mobile phone, tablet, laptop). The links to each session were posted on the ITE provider’s webpage, and were active for six weeks in total, to allow for completion by participants who were not able to meet the weekly schedule.

To begin the SBL intervention, participants first completed a registration form via an online survey platform which included the participant information and consent statement followed by demographic questions. Following registration, participants received an email confirmation which provided further information about the intervention, login details, and the link to the first session in the series. Participants were advised to complete each session independently in one sitting, but there was no formal proctoring of responses. Participants completed a pre-test questionnaire measuring self-efficacy at the start of the first session, and an identical post-test questionnaire at the end of each of the four sessions, along with an open-ended question on participant perceptions on whether and how the intervention influenced their preparation for the teaching placement.

Fig. 1. Example of the scenario-based learning activity and feedback.

2.4. Analyses

We used latent growth curve modelling (LGCM) to assess the trajectory of change in self-efficacy over the five time periods in the intervention (Muth´en & Muth´en, 2017). LGCM is based on structural equation modelling (SEM) and has advantages over other analysis approaches such as repeated measures ANOVA that have traditionally been used in education research to analyze longitudinal data. The advantages of LGCM—a relatively new approach that uses latent variables—is that it evaluates between-group and within-group differences in longitudinal data (Alessandri et al., 2017), accounts for measurement error, and allows for more flexibility to describe non-linear change. Analysis approaches that use latent variables are considered best-practice for the analysis of longitudinal data in education research (Diakow, 2018).

Our LGCM analysis started with an unconditional (or baseline) model which excludes covariates that may explain differences in growth trajectories. After testing the unconditional model, we tested conditional models which included three covariates: ethnicity (ethnic majority group or ethnic minority group), sex (identify as male or female), and age. For each model we tested the intercept (starting point) and the slope (trajectory of change over time) of the data (see Fig. 2 for the proposed LGC model). The intercept represents the initial self-efficacy scores obtained by participants in the pre-test questionnaire and the slope variable represents the change in self-efficacy over the course of the intervention.

Missing data were managed using full information maximum likelihood (FIML) estimation, meaning that data from all participants were included in the analysis, including the participants who had data missing for one or more of the measurement points (Cham et al., 2017). The percentage of missing data was 1.67% for Session 2, 2.38% for Session 3, and 2.85% for Session 4. As the percentage of missing data was under 5%, it was deemed as likely to have a negligible impact on the findings (Jakobsen et al., 2017). Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), and Root Mean Square Error of Approximation (RMSEA), and Standardized Root Mean Square Residual (SRMR) were used to assess goodness-of-fit.

CFI and TLI values above .90, and RMSEA and SRMR values below .08 indicate adequate fit to the data (Little, 2013). We also used Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC) to compare models, with smaller AIC and BIC values suggesting a better fitting model (Vasantha & Venkatesan, 2014). Open-ended responses. Our optional open-ended question on participant perceptions was analyzed using theoretical (i.e., deductive) thematic analysis (e.g., Proudfoot, 2022), an approach that sets out a priori codes, in this case, evidence for the salience of scenario content, personal reflection, and expert feedback relating to teaching confidence. We followed guidance from Robinson (2021) for analysing large samples of brief text data derived from an open-ended response format.

A deductive analysis provides a less rich description of the data than an inductive approach, but when integrated into a predominantly quantitative study, the approach can provide insight into the numerical findings (Proudfoot, 2022). In this study, the unit of analysis was participants whole responses (i.e., 1–2 sentences) to capture the sentiment of their entire responses. We used the deductive analysis to shed light on the relevance of scenario content, reflection, and expert feedback on participants’ views of how the intervention prepared them for the teaching placement.3

3. Results

3.1. Self-Efficacy Scores

Table 1 provides self-efficacy scores by sex and ethnicity for the five time points (pre-test and post-test session scores), with total self-efficacy score and the five domains, along with internal consistency (Cronbach’s alpha) for total and domain scores. Note the similar patterns in selfefficacy scores between participants identifying as male and female (other gender categories were too small to analyze). Participants from minority ethnic backgrounds rated their baseline self-efficacy scores higher than participants from majority ethnic backgrounds (see section on latent growth curve models for additional information). Internal consistency for total self-efficacy and sub-domains was acceptable for the total self-efficacy score and the four multi-item domains, ranging from α = .73 (Cooperate Session 3) to α = .94 (Total SE Session 3).

3.2. Latent growth curve modelling

The first step in LGCM is to test how the data fits the hypothesized growth curve models, to understand if the patterns are mostly linear, or follow another pattern (e.g., curvilinear). We evaluated model fit using a range of fit indices (e.g., chi-square, CFI, TLI, RMSEA) that are frequently used when testing latent growth curve models. The unconditional—or baseline—linear LGC model showed acceptable fit to the data; please see Appendix A for the full range of fit indices. We found that the mean overall self-efficacy score at pre-test was 49.375 (p < .001) and the intercept variance was 43.131 (p < .001), suggesting that there were individual differences in self-efficacy scores at pre-test.

Self-efficacy scores increased on average by 1.005 (p < .001) units between measurement points, while the slope variance was .896 (p < .001), indicating that growth significantly varied between individuals. In response to Research Question 1, we found that self-efficacy scores increased from the pre-test to the first post-test, and remained stable between the first and second post-tests, before rising again in the third and final post-tests. The covariance between the intercept and the slope was negative and significant ( 2.026, p < .001), suggesting that participants with lower initial self-efficacy scores had a greater rate of increase in self-efficacy scores over the intervention period, in comparisonFig. 2.

Proposed Unconditional Latent Growth Curve Model. Note. i = intercept factor; s = slope factor; pre = pre-test; S1 = Session 1 posttest; S2 = Session 2 post-test; S3 = Session 3 post-test; S4 = Session 4 post-test. The loadings for the latent intercept factor were all set to 1 to reflect that this remains constant for each participant over time. The indicator paths for the slope factor were set to 0, 1, 2, 5, and 6 to reflect the units of time (i.e., 7 days) between each measurement point.

3. Some ITE programs using this SBL intervention (although not the program

where we collected data for this study) incorporate weekly follow-up sessions to discuss the nuances of the scenarios and response options in order to further develop pedagogical reasoning. to those with higher initial self-efficacy scores.

3.2.1. Conditional latent growth model for overall self-efficacy beliefs

The time-invariant covariates of age, sex, and ethnicity were then added in a ‘conditional model’ to investigate the extent to which they predicted self-efficacy intercept and slope growth factors. There was no significant effect for age or sex on intercept (starting point) or slope (rate of change). However, ethnicity had a significant effect on self-efficacy scores at baseline (Intercept for ethnicity = 1.143, p = .016, R2 = .072), with participants in the minority ethnic group obtaining higher initial mean scores (M = 49.33, SD = 7.48) in comparison to the majority ethnic group (M = 48.18, SD = 6.76). Ethnicity also had a significant effect on the slope (Slope for ethnicity = .147, p = .04, R2 = .064), indicating that participants in the minority ethnic group who reported higher self-efficacy (initial mean scores), saw a slower increase in selfefficacy scores in comparison to the majority ethnic group.

The rate of change in the slope for participants in the majority ethnic group was 1.339, whereas the rate of change for participants in the minority ethnic group was (1.339 + - .147) = 1.192.

3.2.2. Multigroup latent growth curve models

To address Research Question 2 (and RQ4), we conducted multigroup LGCM to investigate sex differences in the patterns of change in overall self-efficacy beliefs by running the linear model separately for male and female participants. The model suggested that male and female participants experienced similar growth trajectories during the SBL intervention with similar initial mean self-efficacy scores, with M = 49.336 for males, p < .001; M = 49.483 for females, p < .001. Female participants had a larger intercept variance (44.500, p < .001) in comparison to male participants (38.894, p < .001). The rate of increase in self-efficacy scores over the course of the intervention was also similar for male (Slope = 1.074, p < .001) and female participants (Slope = .973, p < .001), with a slightly larger slope variance observed for female participants (.969, p < .001) compared to male participants (.702, p < .001).

The covariance between the intercept and slope was significant and negative for both male ( 1.550, p < .001) and female participants ( 2.338, p < .001). This indicates that in both groups those with higher initial self-efficacy scores had a less steep increase in self-efficacy over the course of the intervention; however, this relationship was more pronounced for female participants. We then investigated the growth trajectories in self-efficacy for the majority vs. minority ethnic groups, χ2 (df = 20) = 530.435 (p < .001). Participants in the majority ethnic group (Intercept = 49.175, p < .001) had slightly lower baseline self-efficacy scores in comparison to participants in the minority ethnic group (Intercept = 50.144, p < .001).

The intercept variance was higher for participants in the minority ethnic group (50.064, p < .001) compared to the majority ethnic group (41.007, p < .001). The rate of change in self-efficacy was 1.029 (Slope variance = .888, p < .001) and .915 (Slope variance = .899, p < .001) for the majority and minority ethnic groups, respectively. The covariance Table 1 Descriptive statistics for self-efficacy total scores and subdomain scores by sex and ethnicity. SE domain All participants Male Female Majority ethnic group Minority ethnic group n α M SD n M SD n M SD n M SD n M SD Pre-test Total SE 1259 .89 48.42 6.93 429 48.56 6.57 816 48.44 7.06 995 48.18 6.76 264 49.33 7.48 Adapt 1259 .93 12.42 2.33 429 12.55 2.25 816 12.39 2.36 995 12.36 2.33 264 12.65 2.35 Discipline 1259 .87 7.24 1.98 429 7.40 1.94 816 7.16 2.00 995 7.14 1.94 264 7.58 2.10 Coop. 1259 .75 10.20 1.43 429 10.17 1.38 816 10.23 1.45 995 10.21 1.40 264 10.15 1.56 Motivate 1259 .85 13.63 2.43 429 13.45 2.29 816 13.75 2.48 995 13.54 2.37 264 13.95 2.62 Succeed 1259 – 4.94 .80 429 5.00 .73 816 4.92 .81 995 4.92 .77 264 5.00 .88 Session 1 post-test Total SE 1259 .92 51.55 7.06 429 51.36 6.73 816 51.75 7.16 995 51.33 6.86 264 52.38 7.75 Adapt 1259 .89 12.90 2.50 429 13.03 2.40 816 12.87 2.52 995 12.79 2.47 264 13.28 2.57 Discipline 1259 .88 9.03 1.71 429 8.97 1.76 816 9.07 1.69 995 9.00 1.67 264 9.15 1.85 Coop. 1259 .74 10.34 1.38 429 10.32 1.30 816 10.37 1.41 995 10.36 1.34 264 10.27 1.52 Motivate 1259 .89 14.19 2.42 429 13.94 2.24 816 14.35 2.48 995 14.12 2.34 264 14.47 2.67 Succeed 1259 – 5.08 .74 429 5.10 .69 816 5.09 .75 995 5.05 .72 264 5.20 .82 Session 2 post-test Total SE 1238 .92 51.47 7.07 420 51.66 6.80 805 51.46 7.15 977 51.31 6.94 261 52.09 7.49 Adapt 1238 .87 13.32 2.33 420 13.42 2.23 805 13.28 2.38 977 13.26 2.29 261 13.52 2.48 Discipline 1238 .87 8.59 1.73 420 8.71 1.71 805 8.55 1.73 977 8.53 1.71 261 8.85 1.77 Coop. 1238 .78 10.28 1.48 420 10.27 1.47 805 10.30 1.49 977 10.30 1.48 261 10.21 1.51 Motivate 1238 .88 14.27 2.27 420 14.21 2.13 805 14.33 2.33 977 14.21 2.25 261 14.48 2.36 Succeed 1238 – 5.01 .74 420 5.05 .75 805 5.00 .73 977 5.01 .72 261 5.03 .78 Session 3 post-test Total SE 1229 .94 53.99 55.40 418 54.31 6.80 797 53.93 7.22 973 54.01 6.96 256 53.91 8.01 Adapt 1229 .91 14.23 2.29 418 14.35 2.16 797 14.21 2.32 973 14.23 2.24 256 14.24 2.46 Discipline 1229 .88 9.22 1.70 418 9.39 1.66 797 9.16 1.66 973 9.19 1.67 256 9.36 1.80 Coop. 1229 .73 10.52 1.40 418 10.59 1.29 797 10.51 1.43 973 10.57 1.36 256 10.35 1.52 Motivate 1229 .90 14.83 2.36 418 14.75 2.22 797 14.91 2.36 973 14.83 2.25 256 14.83 2.72 Succeed 1229 – 5.17 .69 418 5.23 .69 797 5.15 .69 973 5.18 .68 261 5.13 .73 Session 4 post-test Total SE 1223 .95 55.40 7.28 415 55.78 6.90 794 55.32 7.30 967 55.35 7.10 256 55.60 7.92 Adapt 1223 .93 14.69 2.30 415 14.81 2.11 794 14.66 2.35 967 14.67 2.25 256 14.75 2.46 Discipline 1223 .90 9.62 1.70 415 9.77 1.68 794 9.56 1.68 967 9.57 1.66 256 9.79 1.83 Coop. 1223 .82 10.70 1.35 415 10.77 1.30 794 10.68 1.35 967 10.72 1.34 256 10.61 1.40 Motivate 1223 .91 15.09 2.31 415 15.08 2.21 794 15.14 2.30 967 15.08 2.25 256 15.14 2.56 Succeed 1223 – 5.30 .70 415 5.36 .65 794 5.28 .72 967 5.30 .69 256 5.30 .73 Note.

Total SE = Total Self-Efficacy score (Max = 66); Adapt = Adapt instruction to individual student needs domain (Max = 18); Discipline = Maintain discipline domain (Max = 12); Coop. = Cooperate with colleagues and parents domain (Max = 12); Motivate = Motivate students domain (Max = 18); Succeed = Succeed in programme (Max = 6); Majority ethnic group = identify as white British, Scottish, Irish, or Welsh; Minority ethnic group = participants identifying as Black or Black British, Asian or Asian British, and multiple or other ethnic groups. between the intercept and slope was 2.050 (p < .001) for the majority group and 1.768 (p < .001) for the minority group.

This suggests that in both groups those with higher initial self-efficacy scores saw a slower increase in self-efficacy in comparison to those who started with lower self-efficacy beliefs; however, this relationship was stronger for the majority ethnic group. Fig. 3 graphically portrays the changes in mean self-efficacy scores by sex and ethnicity for the five time points, and

Author contributions

Jade V. Rushby: Writing – original draft, Project administration, Investigation, Conceptualization. Robert M. Klassen: Supervision, Project administration, Investigation, Conceptualization. Tracy L. Durksen: Writing – review & editing, Writing – original draft, Methodology, Conceptualization. Andreas Pfaffel: Methodology, Formal analysis, Conceptualization. Lisa Bardach: Writing – review & editing, Writing – original draft, Validation, Methodology, Formal analysis.

Funding

Economic and Social Research Council (ES/X002144/1); European Research Council; European Research Council (647234)

Declaration of competing interest

We followed ethical guidelines set out by our universities and by relevant ethics guidelines (e.g., BERA, APA, AERA). The article has not been submitted or published elsewhere. We did not use generative AI to write or prepare the manuscript. All authors played a substantive role in conducting the research and preparing the manuscript.

Data availability

Data will be made available on request.

References

  1. 1Aarts (2020). Providing a good start. Concerns of beginning secondary school teachers and support provided. European Journal of Teacher Education, 43, 277. https://doi.org/10.1080/02619768.2019.1693992
  2. 2Alessandri (2017). Evaluating intervention programs with a pretest-posttest design: A structural equation modeling approach. Frontiers in Psychology, 8, 223. https://doi.org/10.3389/fpsyg.2017.00223
  3. 3Anderson (2013). Student teaching's contribution to preservice teacher development: A review of research focused on the preparation of teachers for urban and high-needs contexts. Review of Educational Research, 83, 3. https://doi.org/10.3102/0034654312468619
  4. 4Avanzi (2013). Cross-validation of the Norwegian teachers' self-efficacy scale (NTSES). Teaching and Teacher Education, 31, 69. https://doi.org/10.1016/j.tate.2013.01.002
  5. 5Bandura (1997).
  6. 6Bardach (2021). The power of feedback and reflection: Testing an online scenario-based learning intervention for student teachers. Computers and Education, 169, 104194. https://doi.org/10.1016/j.compedu.2021.104194
  7. 7Bardach (2020). Using video-based situational judgment tests for teacher selection: A quasi-experiment exploring the relations between test format, subgroup differences, and applicant reactions. European Journal of Work and Organisational Psychology.
  8. 8Barouch Gilbert (2014). Efficacy beliefs, job satisfaction, stress and their influence on the occupational commitment of English-medium content teachers in the Dominican Republic. Educational Psychology, 34, 876. https://doi.org/10.1080/01443410.2013.814193
  9. 9Berg (2018). The effect of school-based experience on preservice teachers' self-efficacy beliefs. Issues in Educational Research, 28, 530.
  10. 10Boakye (2017). Challenges and solutions: The experiences of newly qualified science teachers. Sage Open, 7. https://doi.org/10.1177/2158244017706710
  11. 11Brown (1989). Situated cognition and the culture of learning. Educational Researcher, 18, 32. https://doi.org/10.3102/0013189X018001032
  12. 12Brown (2015). Does student teaching matter? Investigating pre-service teachers' sense of efficacy and preparedness. Teaching Education, 26, 77. https://doi.org/10.1080/10476210.2014.957666
  13. 13Brown (2021). How pre-service teachers' sense of teaching efficacy and preparedness to teach impact performance during student teaching. Educational Studies, 47, 38. https://doi.org/10.1080/03055698.2019.1651696
  14. 14Burić (2020). Teacher self-efficacy, instructional quality, and student motivational beliefs: An analysis using multilevel structural equation modeling. Learning and Instruction, 66, 1. https://doi.org/10.1016/j.learninstruc.2019.101302
  15. 15Buyse (2011). Situational judgment tests as a new tool for dental student selection. Journal of Dental Education, 75, 743. https://doi.org/10.1002/j.0022-0337.2011.75.6.tb05101.x
  16. 16Cham (2017). Full information maximum likelihood estimation for latent variable interactions with incomplete indicators. Multivariate Behavioral Research, 52, 12. https://doi.org/10.1080/00273171.2016.1245600
  17. 17Chan (2008). General, collective, and domain-specific teacher self-efficacy among Chinese prospective and in-service teachers in Hong Kong. Teaching and Teacher Education, 24, 1057. https://doi.org/10.1016/j.tate.2007.11.010
  18. 18Chaplain (2008). Stress and psychological distress among trainee secondary teachers in England. Educational Psychology, 28, 195. https://doi.org/10.1080/01443410701491858
  19. 19Chesnut (2015). Self-efficacy as a predictor of commitment to the teaching profession: A meta-analysis. Educational Research Review, 15, 1. https://doi.org/10.1016/j.edurev.2015.02.001
  20. 20Çimer (2013). How does reflection help teachers to become effective teachers. International Journal of Educational Research, 1, 133.
  21. 21Coulson (2013). Scaffolding student reflection for experience-based learning: A framework. Teaching in Higher Education, 18, 401. https://doi.org/10.1080/13562517.2012.752726
  22. 22Darling-Hammond (2020). Accountability in teacher education. Action in Teacher Education, 42, 60. https://doi.org/10.1080/01626620.2019.1704464
  23. 23Darling-Hammond (2017).
  24. 24Diakow (2018). Growth curve modelling.
  25. 25Dicke (2015). Reducing reality shock: The effects of classroom management skills training on beginning teachers. Teaching and Teacher Education, 48, 1. https://doi.org/10.1016/j.tate.2015.01.013
  26. 26Durksen (2018). The development of a situational judgment test for teaching in rural and remote Australia. The Australian Educational Researcher, 45, 255. https://doi.org/10.1007/s13384-017-0248-5
  27. 27Errington (2011). Mission possible: Using near-world scenarios to prepare graduates for the professions. International Journal of Teaching and Learning in Higher Education, 23, 84e91.
  28. 28Grossman (2009). Redefining teaching, re‐imagining teacher education. Teachers and Teaching: Theory and Practice, 15, 273. https://doi.org/10.1080/13540600902875340
  29. 29Hascher (2016). Openness to theory and its importance for pre-service teachers' self-efficacy, emotions, and classroom behavior in the teaching practicum. International Journal of Educational Research, 77, 15. https://doi.org/10.1016/j.ijer.2016.02.003
  30. 30Hattie (2011). Instruction based on feedback.
  31. 31Hattie (2007). The power of feedback. Review of Educational Research, 77, 81. https://doi.org/10.3102/003465430298487
  32. 32He (2011). Struggles and strategies in teaching: Voices of five novice secondary teachers. Teacher Education Quarterly, 38, 97.
  33. 33Herrington (1995). Critical characteristics of situated learning: Implications for the instructional design of multimedia.
  34. 34Herrington (2014). Authentic learning environments.
  35. 35Huang (2012). Gender differences in academic self-efficacy: A meta-analysis. European Journal of Psychology of Education, 28, 1. https://doi.org/10.1007/s10212-011-0097-y
  36. 36Jakobsen (2017). When and how should multiple imputation be used for handling missing data in randomised clinical trials–a practical guide with flowcharts. BMC Medical Research Methodology, 17, 1. https://doi.org/10.1186/s12874-017-0442-1
  37. 37Klassen (2021). The development and testing of an online scenario-based learning activity to prepare preservice teachers for teaching placements. Teaching and Teacher Education, 104. https://doi.org/10.1016/j.tate.2021.103385
  38. 38Klassen (2010). Effects on teachers’ self-efficacy and job satisfaction: Teacher gender, years of experience, and job stress. Journal of Educational Psychology, 102, 741. https://doi.org/10.1037/a0019237
  39. 39Klassen (2014). Weekly self-efficacy and work stress during the final teaching practicum: A mixed methods study. Learning and Instruction, 33, 158. https://doi.org/10.1016/j.learninstruc.2014.05.003
  40. 40Klassen (2014). Teachers’ self-efficacy, personality, and teaching effectiveness: A meta-analysis. Educational Research Review, 12, 59. https://doi.org/10.1016/j.edurev.2014.06.001
  41. 41Krieg (2021). Disconnected development? The importance of specific human capital in the transition from student teaching to the classroom. Educational Evaluation and Policy Analysis.
  42. 42Lave (1991).
  43. 43Lindqvist (2017). Resolving feelings of professional inadequacy: Student teachers' coping with distressful situations. Teaching and Teacher Education, 64, 270. https://doi.org/10.1016/j.tate.2017.02.019
  44. 44Little (2013).
  45. 45Loughran (2019). Pedagogical reasoning: The foundation of the professional knowledge of teaching. Teachers and Teaching, 25, 523. https://doi.org/10.1080/13540602.2019.1633294
  46. 46Ma (2022). Changes in pre-service teacher self-efficacy for teaching in relation to professional experience placements. Australian Journal of Education, 66, 57. https://doi.org/10.1177/00049441211060474
  47. 47Mathew (2017). Reflective practices: A means to teacher development. Asia Pacific Journal of Contemporary Education and Communication Technology, 3, 126.
  48. 48Mikeska (2022). Do simulated teaching experiences impact elementary preservice teachers' ability to facilitate argumentation-focused discussions in mathematics and science?. Journal of Teacher Education, 1.
  49. 49Miles (2018). “I sorta felt like I was out in the middle of the ocean”: Novice teachers' transition to the classroom. Australian Journal of Teacher Education, 43, 105. https://doi.org/10.14221/ajte.2018v43n6.7
  50. 50Miulescu (2020). Walking the tightrope: Challenges encountered in novice teachers' practice. Journal of Pedagogy, 1, 115.
  51. 51Mok (2023). What kind of individual support activities in interventions foster pre-service and beginning teachers' self-efficacy? A meta-analysis. Educational Research Review, 100552.
  52. 52Muthén (2017).
  53. 53Parham (2015). Influences on assertiveness: Gender, national culture, and ethnicity. The Journal of Management Development, 34, 421.
  54. 54Patterson (2013). Situational judgement tests: A guide for applicants to the UK foundation programme. Med Sch Counc.
  55. 55Pfitzner-Eden (2016). Why do I feel more confident? Bandura's sources predict preservice teachers' latent changes in teacher self-efficacy. Frontiers in Psychology, 7, 1486. https://doi.org/10.3389/fpsyg.2016.01486
  56. 56Prilop (2019). How digital reflection and feedback environments contribute to pre-service teachers' beliefs during a teaching practicum. Studies In Educational Evaluation, 62, 158. https://doi.org/10.1016/j.stueduc.2019.06.005
  57. 57Proudfoot (2022). Inductive/Deductive hybrid thematic analysis in mixed methods research. Journal of Mixed Methods Research.
  58. 58Robinson (2021). Conducting thematic analysis on brief texts: The structured tabular approach. Qualitative Psychology, 9, 194. https://doi.org/10.1037/qup0000189
  59. 59Sheu (2018). Sources of self-efficacy and outcome expectations in science, technology, engineering, and mathematics domains: A meta-analysis. Journal of Vocational Behavior, 109, 118. https://doi.org/10.1016/j.jvb.2018.10.003
  60. 60Shulman (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57, 1. https://doi.org/10.17763/haer.57.1.j463w79r56455411
  61. 61Skaalvik (2007). Dimensions of teacher self-efficacy and relations with strain factors, perceived collective teacher efficacy, and teacher burnout. Journal of Educational Psychology, 99, 611. https://doi.org/10.1037/0022-0663.99.3.611
  62. 62Skaalvik (2017). Teacher stress and teacher self-efficacy: Relations and consequences.
  63. 63Suprayogi (2017). Teachers and their implementation of differentiated instruction in the classroom. Teaching and Teacher Education, 67, 291. https://doi.org/10.1016/j.tate.2017.06.020
  64. 64Swan (2011). Changes in teacher self-efficacy from the student teaching experience through the third year of teaching. Journal of Agricultural Education, 52, 128. https://doi.org/10.5032/jae.2011.02128
  65. 65Thurlings (2012). Development of the teacher feedback observation scheme: Evaluating the quality of feedback in peer groups. Journal of Education for Teaching, 38, 193. https://doi.org/10.1080/02607476.2012.656444
  66. 66Tschannen-Moran (2007). The differential antecedents of self-efficacy beliefs of novice and experienced teachers. Teaching and Teacher Education, 23, 944. https://doi.org/10.1016/j.tate.2006.05.003
  67. 67Tschannen-Moran (2001). Teacher efficacy: Capturing an elusive construct. Teaching and Teacher Education, 17, 783. https://doi.org/10.1016/S0742-051X(01)00036-1
  68. 68Vasantha (2014). Structural equation modeling of latent growth curves of weight gain among treated tuberculosis patients. PLoS One, 9. https://doi.org/10.1371/journal.pone.0091152
  69. 69Watzke (2007). Longitudinal research on beginning teacher development: Complexity as a challenge to concerns-based stage theory. Teaching and Teacher Education, 23, 106. https://doi.org/10.1016/j.tate.2006.04.001
  70. 70Weber (2018). Promoting pre-service teachers' professional vision of classroom management during practical school training: Effects of a structured online-and video-based self-reflection and feedback intervention. Teaching and Teacher Education, 76, 39. https://doi.org/10.1016/j.tate.2018.08.008
  71. 71Wieringa (2011). Teachers' educational design as a process of reflection‐in‐action: The lessons we can learn from Donald Schön’s the Reflective Practitioner when studying the professional practice of teachers as educational designers. Curriculum Inquiry, 41, 167. https://doi.org/10.1111/j.1467-873X.2010.00533.x
  72. 72Yoon (2022). Dynamic patterns of teachers' professional development participation and their relations with socio-demographic characteristics, teacher self-efficacy, and job satisfaction. Teaching and Teacher Education, 109. https://doi.org/10.1016/j.tate.2021.103565
  73. 73Zee (2016). Teacher self-efficacy and its effects on classroom processes, student academic adjustment, and teacher well-being: A synthesis of 40 years of research. Review of Educational Research, 86, 981. https://doi.org/10.3102/0034654315626801