Design and psychometric validation of a holistic instrument for organizational diagnosis based on the DIO Model in micro, small and medium-sized enterprises

Authors

  • Rosalío Tortolero Juarez University of the State of Durango image/svg+xml Author
  • Ignacio Gómez Juarez University of the State of Durango image/svg+xml Author
  • Geovani Figueroa Juarez University of the State of Durango image/svg+xml Author

DOI:

https://doi.org/10.35622/j.rg.2026.03.001

Keywords:

Organizational change, evaluation, management, decision-making

Abstract

The objective of the research was to design and validate a holistic organizational diagnostic instrument for micro, small, and medium-sized enterprises (MSMEs), based on the Organizational Diagnosis and Intervention (DIO) model. An instrumental study was conducted using a quantitative approach, a non-experimental design, and a cross-sectional timeframe. The instrument was structured around the model's formal and informal dimensions, and validation involved expert judgment, correlation analysis, exploratory factor analysis, and an assessment of internal consistency. The sample consisted of 210 employees from three MSMEs located in the state of Durango, Mexico, selected through non-probability convenience sampling. The validation process reduced an initial pool of 215 items to a final version of 64 items. Sampling adequacy was verified using the Kaiser-Meyer-Olkin measure, yielding values of 0.614 for formal variables and 0.627 for informal variables; additionally, Bartlett's test of sphericity was significant in both cases (p < 0.001). Exploratory factor analysis identified seven components for formal variables and nine for informal variables, explaining 74.579% and 78.508% of the cumulative variance, respectively. Reliability analysis yielded Cronbach's alpha coefficients of 0.877 for formal variables, 0.932 for informal variables, and 0.946 for the instrument as a whole. It is concluded that the instrument demonstrates favorable evidence regarding content validity, internal structure, and reliability, making it a useful tool for organizational diagnosis in MSMEs.

Downloads

Download data is not yet available.

References

AERA, APA, & NCME. (2014). Standards for Educational and Psychological Testing. American Educational Research Association.

Aiken, L. R. (2003). Tests psicológicos y evaluación. Pearson Educación.

Amoa-Gyarteng, K., & Dhliwayo, S. (2024). Cultivating success: Organizational culture’s influence on innovation and performance in SMEs. Cogent Business & Management, 11(1), 2397070. https://doi.org/10.1080/23311975.2024.2397070

Ato, M., López-García, J. J., & Benavente, A. (2013). Un sistema de clasificación de los diseños de investigación en psicología. Anales de Psicología, 29(3), 1038–1059. http://dx.doi.org/10.6018/analesps.29.3.178511

Bergkvist, L., & Rossiter, J. R. (2007). The predictive validity of multiple-item versus single-item measures. Journal of Marketing Research, 44(2), 175–184. https://doi.org/10.1509/jmkr.44.2.175

Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research. Frontiers in Public Health, 6, 149. https://doi.org/10.3389/fpubh.2018.00149

Burke, W. W., & Litwin, G. H. (1992). A causal model of organizational performance and change. Journal of Management, 18(3), 523–545. https://doi.org/10.1177/014920639201800306

Conti, T. A. (2014). Organizational assessment models. Wiley StatsRef: Statistics Reference Online. John Wiley & Sons. https://doi.org/10.1002/9781118445112.stat04017

Cruz Maldonado, J. C., Abrego-Almazán, D., & Medina-Quintero, J. M. (2022). Effects of IT and organizational capabilities on SME performance. Contaduría y Administración, 67(2). https://doi.org/10.22201/fca.24488410e.2022.3168

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/BF02310555

DeVellis, R. F. (2017). Scale Development: Theory and Applications (4th ed.). Sage.

Diamantopoulos, A., Sarstedt, M., Fuchs, C., Wilczynski, P., & Kaiser, S. (2012). Guidelines for choosing between multi-item and single-item scales. Journal of the Academy of Marketing Science, 40(3), 434–449. https://link.springer.com/article/10.1007/s11747-011-0300-3

Field, A. (2018). Discovering Statistics Using IBM SPSS Statistics (5th ed.). Sage.

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2022). Multivariate data analysis (8th ed.). Cengage Learning. https://pesquisa.bvsalud.org/portal/resource/pt/biblio-1074274

Hernández-Sampieri, R., & Mendoza, C. (2020). Metodología de la investigación: las rutas cuantitativa, cualitativa y mixta.

Jo, Y., & Hong, A. J. (2023). Development and validation of a readiness for organizational change scale. SAGE Open, 13(4). https://doi.org/10.1177/21582440231207705

Joshi, A., Kale, S., Chandel, S., & Pal, D. (2015). Likert scale: Explored and explained. British Journal of Applied Science & Technology, 7(4), 396–403. https://journalcjast.com/index.php/CJAST/article/view/381

Kalkbrenner, M. T. (2024). Choosing between Cronbach’s coefficient alpha, McDonald’s coefficient omega, and coefficient H: Confidence intervals and the advantages and drawbacks of interpretive guidelines. Measurement and Evaluation in Counseling and Development, 57(2), 93–105.

https://doi.org/10.1080/07481756.2023.2283637

Karsantık, İ., & Çayak, S. (2025). Development of organizational healing scale: Validity and reliability study. Frontiers in Psychology, 15. https://doi.org/10.3389/fpsyg.2024.1491182

Kyriazos, T. A. (2018). Applied psychometrics: Sample size and sample power considerations in factor analysis. Psychology, 9(8), 2207-2230. https://doi.org/10.4236/psych.2018.98126

Liu, X., Zhao, C., Chen, Z., & Wang, Q. (2022). Development and validation of the online interaction scale in organizational context. Frontiers in Psychology, 13, 884820.

https://doi.org/10.3389/fpsyg.2022.884820

Merino-Soto, C. (2023). Coeficientes V de Aiken: diferencias en los juicios de validez de contenido. MHSalud, 20(1), 1–10. https://doi.org/10.15359/mhs.20-1.3

Messick, S. (1995). Validity of psychological assessment. American Psychologist, 50(9), 741–749. https://psycnet.apa.org/record/1996-10004-001

Muñiz, J., & Fonseca-Pedrero, E. (2019). Ten steps for test development. Psicothema, 31(1), 7–16. https://doi.org/10.7334/psicothema2018.291

Müller, A.-M., Sachs, S., Rieder, Y., & Lahmann, C. (2026). The Systematic Psychodynamic Multidimensional Organizational Assessment Questionnaire: Protocol for a development and validation study. JMIR Research Protocols, 15, e78530. https://www.researchprotocols.org/2026/1/e78530

Nadler, D. A., & Tushman, M. L. (1980). A model for diagnosing organizational behavior. Organizational Dynamics, 9(2), 35–51. https://www.sciencedirect.com/science/article/abs/pii/009026168090039X?via%3Dihub

Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric Theory (3rd ed.). McGraw-Hill.

Polit, D. F., & Beck, C. T. (2006). The content validity index. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147

Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Research in Nursing & Health, 30(4), 459–467. https://doi.org/10.1002/nur.20199

Rhydderch, M., Edwards, A., Elwyn, G., Marshall, M., Engels, Y., Van den Hombergh, P., & Grol, R. (2005). Organizational assessment in general practice: A systematic review and implications for quality improvement. Journal of Evaluation in Clinical Practice, 11(4), 366–378. https://doi.org/10.1111/j.1365-2753.2005.00544.x

Sireci, S. G., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26(1), 100–107. https://reunido.uniovi.es/index.php/PST/article/view/10224

Taber, K. S. (2018). The use of Cronbach's alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 1273-1296. https://doi.org/10.1007/s11165-016-9602-2

Tortolero-Portugal, R., Gómez-Romero, J. G. I., Figueroa-González, E. G., & Moreno-Loera, H. (2024). El diagnóstico y la intervención organizacional. Métodos utilizados por las organizaciones para su desarrollo integral. Gestionar: Revista de Empresa y Gobierno, 4(3), 36-53. https://doi.org/10.35622/j.rg.2024.03.003

Tortolero, R., Gómez, J., y Figueroa, E. (2025). Desarrollo de un modelo holístico de diagnóstico organizacional para intervenciones en Micro, Pequeñas y Medianas Empresas. Gestionar: revista de empresa y gobierno, 5(4), 36-50. https://revistas.inudi.edu.pe/index.php/rg/es/article/view/399

Ventura-León, J. (2022). De regreso a la validez basada en el contenido. Adicciones, 34(4), 323–326. https://doi.org/10.20882/adicciones.920

Verenzuela-Barroeta, D. A., Salas-Hernández, A. J., & Araque-Manrique, M. C. (2024). Diseño y validación psicométrica de una escala de medición del clima organizacional en pymes. Estudios Gerenciales, 40(172), 297–313. https://doi.org/10.18046/j.estger.2024.172.6653

Wang, Z. (2022). Development and validation of a motivation scale for status pursuit by organization members. Frontiers in Psychology, 13, 844325. https://doi.org/10.3389/fpsyg.2022.844325

Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219-246. https://doi.org/10.1177/0095798418771807

Weisbord, M. R. (1976). Organizational diagnosis: Six places to look for trouble with or without a theory. Group & Organization Studies, 1(4), 430–447. https://doi.org/10.1177/105960117600100405

Woo, H. R. (2025). Strategic leadership in SMEs. Administrative Sciences, 15(4), 151. https://doi.org/10.3390/admsci15040151

Worthington, R. L., & Whittaker, T. A. (2006). Scale development research. The Counseling Psychologist, 34(6), 806–838. https://doi.org/10.1177/0011000006288127

Downloads

Published

2026-09-21

Issue

Section

Artículos originales

How to Cite

Tortolero, R., Gómez, I., & Figueroa, G. (2026). Design and psychometric validation of a holistic instrument for organizational diagnosis based on the DIO Model in micro, small and medium-sized enterprises. Gestionar: Revista De Empresa Y Gobierno, 6(3), 7-32. https://doi.org/10.35622/j.rg.2026.03.001

Most read articles by the same author(s)

Similar Articles

1-10 of 114

You may also start an advanced similarity search for this article.