Skip to content
Teaching and Education Research

An international forum for rigorous research on teaching, learning and teacher education

Research articleOpen access

Comparing the preference of diagnostic information from variations of dynamic testing, criterion- and norm-referenced testing for individualized education planning

Show affiliations and correspondence
  1. aInstitute of Special Education, Leibniz University Hannover, Schloßwender Str. 1, Hannover, 30159, Germany
  2. bInstitute of Education and Child Studies, Leiden University, Wassenaarseweg 52, Leiden, AK 2333, The Netherlands

DOI: https://doi.org/10.1016/j.tate.2026.105854

Outline

Abstract

The aim of this study was to compare pre-service teachers' preference of information stemming from different diagnostic approaches. Participants ( N = 185) evaluated vignettes containing diagnostic information from norm-referenced testing, criterion-referenced testing, and two types of information coming from dynamic testing (Graduated Prompt training scores and pretest/posttest scores). They rated these vignettes regarding their usefulness for understanding a child's difficulties and for planning individualized education. Additionally, attitudes towards diagnostics, beliefs about diagnostic goals and prior knowledge of diagnostic approaches were examined as potential moderators. Overall, information from norm-referenced testing was seen as least useful. No differences were found between the other diagnostic approaches. Moderation effects were found for all of the assessed variables.

References

  1. 1Adelson (2012). Examining relationships and effects in gifted education research: An introduction to structural equation modeling. Gifted Child Quarterly, 56, 47. https://doi.org/10.1177/0016986211424132
  2. 2Ajzen (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179. https://doi.org/10.1016/0749-5978(91)90020-T
  3. 3Beckmann (2014). The umbrella that is too wide and yet too small: Why dynamic testing has still not delivered on the promise that was never made. Journal of Cognitive Education and Psychology, 13, 308. https://doi.org/10.1891/1945-8959.13.3.308
  4. 4Bejar (1984). Educational diagnostic assessment. Journal of Educational Measurement, 21, 175. https://doi.org/10.1111/j.1745-3984.1984.tb00228.x
  5. 5Bosma (2012). Teachers' preferences for educational planning: Dynamic testing, teaching’ experience and teachers' sense of efficacy. Teaching and Teacher Education, 28, 560. https://doi.org/10.1016/j.tate.2012.01.007
  6. 6Bosma (2008). Bridging the gap between diagnostic assessment and classroom practice. Journal of Cognitive Education and Psychology, 7, 174. https://doi.org/10.1891/194589508787381854
  7. 7Bosma (2010). Teacher's appraisal of dynamic assessment outcomes: Recommendations for weak mathematics-performers. Journal of Cognitive Education and Psychology, 9, 91. https://doi.org/10.1891/1945-8959.9.2.91
  8. 8Bosma (2012). Need for instruction: Dynamic testing in special education. European Journal of Special Needs Education, 27, 1. https://doi.org/10.1080/08856257.2011.613599
  9. 9Bosma (2017). Differences in need for instruction: Dynamic testing in children with arithmetic difficulties. Journal of Education and Training Studies, 5, 132. https://doi.org/10.11114/jets.v5i6.2326
  10. 10Caffrey (2008). The predictive validity of dynamic assessment: A review. The Journal of Special Education, 41, 254. https://doi.org/10.1177/0022466907310366
  11. 11Chen (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14, 464. https://doi.org/10.1080/10705510701301834
  12. 12Chen (2026). A comparison of methods for testing measurement invariance with unbalanced data. Structural Equation Modeling: A Multidisciplinary Journal, 33, 404. https://doi.org/10.1080/10705511.2025.2591420
  13. 13Delclos (1993). A comparison of teachers' responses to dynamic and traditional assessment reports. Journal of Psychoeducational Assessment, 11, 46. https://doi.org/10.1177/073428299301100106
  14. 14Deutsch (2000). The use of dynamic assessment by educational psychologists in the UK. Educational Psychology in Practice, 16, 311. https://doi.org/10.1080/713666083
  15. 15Dong (2021). Power analyses for moderator effects with (non)randomly varying slopes in cluster randomized trials. Methodology, 17, 92. https://doi.org/10.5964/meth.4003
  16. 16Eding (2025). Dynamic testing of learning potential of children with moderate to severe intellectual disabilities: A Delphi study. Journal of Research in Special Educational Needs, 25, 32. https://doi.org/10.1111/1471-3802.12706
  17. 17Elliott (2003). Dynamic assessment in educational settings: Realising potential. Educational Review, 55, 15. https://doi.org/10.1080/00131910303253
  18. 18Feuerstein (2015).
  19. 19Fietzer (2025). A review and guide to structural equation modeling in counseling psychology research. The Counseling Psychologist, 53, 848. https://doi.org/10.1177/00110000251352577
  20. 20Fogarty (2008). Principles and applications of educational and psychological testing.
  21. 21Freeman (2001). Norm-referenced, criterion-referenced, and dynamic assessment: What exactly is the point?. Educational Psychology in Practice, 17, 3. https://doi.org/10.1080/02667360120039942
  22. 22Gabriel (2026). Evaluating the benefits of dynamic testing of arithmetic skills for developing individualized education plans. International Journal for Research in Learning Disabilities, 9, 3. https://doi.org/10.28987/9.1
  23. 23Grigorenko (2009). Dynamic assessment and response to intervention: Two sides of one coin. Journal of Learning Disabilities, 42, 111. https://doi.org/10.1177/0022219408326207
  24. 24Guskey (2002). Professional development and teacher change. Teachers and Teaching, 8, 381. https://doi.org/10.1080/135406002100000512
  25. 25Hair (2021).
  26. 26Hoth (2016). Diagnostic competence of primary school mathematics teachers during classroom situations. ZDM, 48, 41. https://doi.org/10.1007/s11858-016-0759-y
  27. 27Hothorn.
  28. 28Hu (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1. https://doi.org/10.1080/10705519909540118
  29. 29Jabůrek (2022). What is the basis of teacher judgment of student cognitive abilities and academic achievement and what affects its accuracy?. Contemporary Educational Psychology, 69. https://doi.org/10.1016/j.cedpsych.2022.102068
  30. 30Kaplan (1995). A study of the power associated with testing factor mean differences under violations of factorial invariance. Structural Equation Modeling: A Multidisciplinary Journal, 2, 101. https://doi.org/10.1080/10705519509539999
  31. 31Kenny (2015). The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research, 44, 486. https://doi.org/10.1177/0049124114543236
  32. 32Ketterlin-Geller (2009). Diagnostic assessments in mathematics to support instructional decision making. Practical Assessment, Research and Evaluation, 14, 1.
  33. 33Kline (2011).
  34. 34Klug (2016). Which variables predict teachers diagnostic competence when diagnosing students' learning behavior at different stages of a teacher's career?. Teachers and Teaching, 22, 461. https://doi.org/10.1080/13540602.2015.1082729
  35. 35Kuznetsova (2020). lmerTest: Tests in linear mixed effects models. Computer Software.
  36. 36Lai (2013). Data-based decision making: An overview.
  37. 37Lockwood (2022). The course on norm‐referenced academic assessment: A survey of special education faculty. Psychology in the Schools, 59, 398. https://doi.org/10.1002/pits.22616
  38. 38Lüdecke.
  39. 39Mathieu (2012). Understanding and estimating the power to detect cross-level interaction effects in multilevel modeling. Journal of Applied Psychology, 97, 951. https://doi.org/10.1037/a0028380
  40. 40McDowell (2011). Does assessment for learning make a difference? The development of a questionnaire to explore the student response. Assessment & Evaluation in Higher Education, 36, 749. https://doi.org/10.1080/02602938.2010.488792
  41. 41Ohle (2015). Teachers' diagnostic competences and their practical relevance. Special issue editorial. Journal for Educational Research Online, 7, 5.
  42. 42Ohle (2015). Text-picture integration—Teachers’ attitudes, motivation and self-related cognitions in diagnostics. Journal for Educational Research Online, 7, 11.
  43. 43Pelco (2009). Teacher ratings of three psychological report styles. Training and Education in Professional Psychology, 3, 19. https://doi.org/10.1037/1931-3918.3.1.19
  44. 44Prenger (2018). Data-based decision making for teacher and student learning: A psychological perspective on the role of the teacher. Educational Psychology, 38, 734. https://doi.org/10.1080/01443410.2018.1426834
  45. 45Resing (2013). Dynamic testing and individualized instruction: Helpful in cognitive education?. Journal of Cognitive Education and Psychology, 12, 81. https://doi.org/10.1891/1945-8959.12.1.81
  46. 46Resing (2011). Dynamic testing with tangible electronics: Measuring children's change in strategy use with a series completion task. British Journal of Educational Psychology, 81, 579. https://doi.org/10.1348/2044-8279.002006
  47. 47Resing (2012). Dynamic testing and assessment.
  48. 48Resing (2020). Assessing potential for learning in school children.
  49. 49Resing (2009). Dynamic testing in indigenous and ethnic minority children. Learning and Individual Differences, 19, 445. https://doi.org/10.1016/j.lindif.2009.03.006
  50. 50Revelle.
  51. 51Salvagno (1987). Teacher perceptions of different types of information in psychological reports. Journal of School Psychology, 25, 415. https://doi.org/10.1016/0022-4405(87)90045-8
  52. 52Schellekens (2021). A scoping review on the notions of assessment as learning (AaL), assessment for learning (AfL), and assessment of learning (AoL). Studies In Educational Evaluation, 71. https://doi.org/10.1016/j.stueduc.2021.101094
  53. 53Seo (2016). On the benefits of latent variable modeling for norming scales: The case of the supports intensity scale – children's version. International Journal of Behavioral Development, 40, 373. https://doi.org/10.1177/0165025415591230
  54. 54Shulman (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15, 4. https://doi.org/10.3102/0013189X015002004
  55. 55Shulman (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57, 1. https://doi.org/10.17763/haer.57.1.j463w79r56455411
  56. 56Smolkowski (2015). Evaluation of diagnostic systems: The selection of students at risk of academic difficulties. Assessment for Effective Intervention, 41, 41. https://doi.org/10.1177/1534508415590386
  57. 57Sternberg (2002).
  58. 58Sternberg (2002). Assessing intellectual potential in rural Tanzanian school children. Intelligence, 30, 141. https://doi.org/10.1016/S0160-2896(01)00091-5
  59. 59Stevenson (2016). Dynamic testing: Assessing cognitive potential of children with culturally diverse backgrounds. Learning and Individual Differences, 47, 27. https://doi.org/10.1016/j.lindif.2015.12.025
  60. 60Tiekstra (2016). A review scrutinising the consequential validity of dynamic assessment. Educational Psychology, 36, 112. https://doi.org/10.1080/01443410.2014.915930
  61. 61Trittel (2014). Training prospective teachers in educational diagnostics.
  62. 62Tzuriel (2001). Dynamic assessment is not dynamic testing. Issues in Education, 7, 237.
  63. 63Veerbeek (2025). Dynamic testing of instructional needs: A training-only graduated prompts approach. Journal of Psychoeducational Assessment, 43, 74. https://doi.org/10.1177/07342829241287947
  64. 64Wilbert.
  65. 65Wiliam (2011). What is assessment for learning?. Studies In Educational Evaluation, 37, 3. https://doi.org/10.1016/j.stueduc.2011.03.001
  66. 66Yan (2015). Primary teachers' attitudes, intentions and practices regarding formative assessment. Teaching and Teacher Education, 45, 128. https://doi.org/10.1016/j.tate.2014.10.002
  67. 67Yoon (2018). Testing factorial invariance with unbalanced samples. Structural Equation Modeling: A Multidisciplinary Journal, 25, 201. https://doi.org/10.1080/10705511.2017.1387859
  68. 68Zeichner (1981). Are the effects of university teacher education “Washed Out” by school experience?. Journal of Teacher Education, 32, 7. https://doi.org/10.1177/002248718103200302