Convergent validity of SPARO and MMPI-2 questionnaires
Abstract
In the previous study (Cígler & Rudá, 2021), we were not able to confirm satisfactory internal consistency and factor validity of the SPARO questionnaire. However, further psychometric properties are also necessary to consider the questionnaire's validity and usefulness in practice. In this follow up study, we examined its criterion validity to MMPI-2, which is used globally and thus has broader empirical support. Despite that, we did not find any support for neither convergent nor divergent validity of the main components, general factor, and the credibility score (L) of SPARO questionnaire to selected MMPI-2 scales. The only exception was the emotional variability scale (EM). As a minor result, we also examined the internal consistency and factor validity of MMPI-2 scales as no other Czech study concerning the questionnaire exists. Neither reliability nor factor validity was satisfactory. Finally, we argue that using the SPARO questionnaire in regular practice cannot be recommended. Cautious use of the MMPI-2 is possible, regarding international validation studies, however, further Czech research is needed, especially in the predictive validity.
https://doi.org/10.29364/epsy.392
(Fulltext in Czech)
Keywords
convergent validity, divergent validity, SPARO, MMPI-2, Minnesota Multiphasic Personality Inventory, Police of the Czech Republic, personal selectionLiterature
AERA, APA, & NCME. (2014). Standards for Educational and Psychological Testing. American Educational Research Association. Bednárová, B. (2016). Skresľovanie odpovedí v osobnostných dotazníkoch v kontexte výberového konania. Diplomová práce. Masarykova uhiverzita. https://is.muni.cz/th/o0fgs/
Benton, T. (2015). An empirical assessment of Guttman’s lambda 4 reliability coefficient. In R. Millsap, D. Bolt, L. van der Ark, & W. C. Wang (Eds.), Quantitative Psychology Research. Springer Proceedings in Mathematics & Statistics, vol. 89 (pp. 301–310). Springer. https://doi.org/…-319-07503-7
Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., Kaemmer, B., & Netík, K. (2002). MMPI 2: Minnesota Multiphasic Personality Inventory-2.
Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., Kaemmer, B., & Netík, K. (2013). MMPI-2 – Minnesota Multiphasic Personality Inventory-2 : Druhé rozšířené vydání. Testcentrum.
Chalmers, R. P. (2018). On misconceptions and the limited usefulness of ordinal alpha. Educational and Psychological Measurement, 78(6). https://doi.org/…164417727036
Cheng, M. K. (2006). Structural equation modeling of the Restructured Clinical scales of the MMPI-2. Thesis. University of Windsor. https://scholar.uwindsor.ca/etd/7215
Cígler, H., & Rudá, A. (2021). Reliabilita a faktorová validita dotazníku SPARO. E-psychologie, 15(1), 16–39. https://doi.org/…364/epsy.391
Čurdová, J., & Pourová, M. (2019). Minnesota Multiphasic Personality Inventory 2 – Recenze metody. TESTFÓRUM, 7(12), 6. https://doi.org/…019-12-12447
Farnikova, K., Obereigneru, R., Kanovsky, P., & Prasko, J. (2012). Comparison of personality characteristics in Parkinson disease patients with and without impulse control disorders and in healthy volunteers. Cognitive And Behavioral Neurology, 25(1), 25–33. https://doi.org/…3e31824b4103
Friedman, A. F., Bolinskey, P. K., Levak, R. W., & Nichols, D. S. (2015). Psychological assessment with the MMPI-2/MMPI-2-RF (3rd ed.). Routledge.
Gadermann, A. M., Guhn, M., & Zumbo, B. D. (2012). Estimating ordinal reliability for Likert-Type and ordinal Item Response Data: A conceptual, empirical, and practical guide – practical assessment, research & evaluation. Practical Assessment, Research, and Evaluation, 17(3), 1–13. https://doi.org/…75/n560-j767
Green, S. B., & Yang, Y. (2009). Reliability of summed item scores using structural equation modeling: An alternative to coefficient alpha. Psychometrika, 74(1), 155–167. https://doi.org/…6-008-9099-3
Greene, R. L. (2000). The MMPI-2: An interpretive manual. Allyn and Bacon.
Guttman, L. (1945). A basis for analyzing test-retest reliability. Psychometrika, 10(4), 255–282. https://doi.org/…7/BF02288892
Hajný, M. (2018). Vybrané psychometrické analýzy dotazníku MMPI-2. Diplomová práce. Masarykova univerzita. https://is.muni.cz/th/b8prs/
Hansmanová, L., Obereignerů, R., & Šmahaj, J. (2007). Psychosomatické aspekty zhoubného nádoru těla děložního. Česká gynekologie, 72(4), 304–308.
Hathaway, S. R., & McKinley, J. C. (1942). Manual for the Minnesota Multiphasic Personality Inventory. University of Minnesota Press.
Hoelzle, J. B., & Meyer, G. J. (2008). The factor structure of the MMPI-2 restructured clinical (RC) scales. Journal of Personality Assessment, 90(5), 443–455. https://doi.org/…890802248711
Jensovsky, J., Ruzicka, E., Spackova, N., & Hejdukova, B. (2002). Changes of event related potentials and cognitive processes in patients with subclinical hypothyroidism after thyroxine treatment. Endocrine Regulations, 36(3), 115–122.
Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2020). semTools: Useful tools for structural equation modeling (0.5–3). https://cran.r-project.org/…age=semTools
Jurišová, E., & Sarmány-Schuller, I. (2013). Structure of basal psychical self-regulation and personality integration in relation to coping strategies in decision-making in paramedics. Studia Psychologica, 55(1), 3–18. https://doi.org/….2013.01.617
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2014). The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research, 44(3), 486–507. https://doi.org/…124114543236
Kudela, M., & Hansmanová, L. (2014). Psychosomatické aspekty a léčba psychofarmaky v etiopatogenezi karcinomu endometria. Česká gynekologie, 79(5), 378–381.
Lakens, D. (2017). Equivalence tests. Social Psychological and Personality Science, 8(4), 355–362. https://doi.org/…550617697177
Líbalová, Z., Feyereisl, J., Martan, A., Cepický, P., Halaska, M., Krofta, L., Váchová, D., Balcarová, J., & Pecená, M. (2001). Psychologie inkontinence moce. I. Srovnání žen s urgentní a stresovou inkontinencí před zahájením terapie. Česká gynekologie, 66(3), 171–174.
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Addison-Wesley.
Mangiafico, S. (2020). rcompanion: Functions to Support Extension Education Program Evaluation (R package version 2.3.21). https://cran.r-project.org/…e=rcompanion
Mikšík, O. (1992). IHAVEZ – SPIDO – VAROS (příručka). Psychodiagnostika.
Mikšík, O. (2001). Zjišťování bazální struktury a dynamiky autoregulace, integrovanosti a psychické odolnosti osobnosti dotazníky SPARO, BAROM, IHATRANS (manuál). Diaros.
Mikšík, O. (2004). Dotazník SPARO (příručka). Psychodiagnostika.
Mikšík, O. (2007). Psychologická charakteristika osobnosti. Karolinum.
Mikšík, O. (2009). Psychika osobnosti v období závažných životních a společenských změn. Karolinum.
Netík, K. (2003). Příloha C: Složení škál.
Nichols, D. S. (2011). Essentials of MMPI-2 Assessment. John Wiley & Sons, Inc.
Norcross, J. C., Koocher, G. P., & Garofalo, A. (2006). Discredited psychological treatments and tests: A Delphi poll. Professional Psychology: Research and Practice, 37(5), 515–522. https://doi.org/…028.37.5.515
Obereignerů, K., Mareš, J., Obereignerů, R., & Kanovský, P. (2010). The Occurence of Psychogenic Disorders in Neurology. Česká a slovenská neurologie a neurochirurgie, 73(5), 529–533.
Phillips, N. (2017). yarrr: A Companion to the e-Book “YaRrr!: The Pirate’s Guide to R” (R package version 0.1.5). https://cran.r-project.org/package=yarrr
Preiss, J., & Haas, T. (1997). Některé psychometrické charakteristiky české verze Washingtonského psychosociálního dotazníku pro záchvatová onemocnění (WPSI). Československá psychologie, 41(4), 334–346.
Prokopová, P. (2011). Analýza osobnostní struktury uchazeče o službu v profesionálním hasičském záchranném sboru. Diplomová práce. Masarykova univerzita. https://is.muni.cz/th/hny4h/
R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
Revelle, W. (2019). psych: Procedures for Personality and Psychological Research (1.9.12). Northwestern University. https://cran.r-project.org/package=psych
Revelle, W., & Zinbarg, R. E. (2009). Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma. Psychometrika, 74(1), 145–154. https://doi.org/…6-008-9102-z
Rose, E. M., Mathew, T., Coss, D. A., Lohr, B., & Omland, K. E. (2018). A new statistical method to test equivalence: an application in male and female eastern bluebird song. Animal Behaviour, 145, 77–85. https://doi.org/….2018.09.004
Rosseel, Y. (2012). lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1–36. http://www.jstatsoft.org/v48/i02/
Sellbom, M., Fischler, G. L., & Ben-Porath, Y. S. (2007). Identifying MMPI-2 predictors of police officer integrity and misconduct. Criminal Justice and Behavior, 34(8), 985–1004. https://doi.org/…854807301224
Signorell, A., & et al. (2020). DescTools: Tools for descriptive statistics (R package version 0.99.32). https://cran.r-project.org/…ge=DescTools
Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s Alpha. Psychometrika, 74(1), 107–120. https://doi.org/…6-008-9101-0
Spearman, C. (1904). The Proof and measurement of association between two things. The American Journal of Psychology, 15(1), 72. https://doi.org/10.2307/1412159
Stancak, A., Hubova, D., Skorodensky, M., Kollar, J., & Mrinak, J. (1986). Clinical symptomatology of the style of Type A behavior pattern according to the MMPI-100. Studia Psychologica, 28(1), 73–79.
Stříteský, M. (2018). Právní aspekty pracovně psychologické diagnostiky. Testfórum, 6(10), 23–31. https://doi.org/…F2018-10-179
Šucha, M., Šťastná, L., & Zámečník, P. (2017). Osobnostní vlastnosti řidičů řídících pod vlivem alkoholu. Adiktologie, 17(1), 34–44.
Svoboda, M., Řehan, V., Vtípil, Z., Klimusová, H., Humpolíček, P., Urbánek, T., & Kouhoutek, T. (2004). Aplikovaná psychodiagnostika v České republice. MSD.
Tellegen, A., Ben-Porath, Y. S., McNulty, J. L., Arbisi, P. A., Graham, J. R., & Kaemmer, B. (2003). MMPI-2 Restructured Clinical (RC) Scales: Development, validation, and interpretation. University of Minnesota Press.
Tellegen, Auke, & Ben-Porath, Y. S. (1992). The new uniform T scores for the MMPI–2: Rationale, derivation, and appraisal. Psychological Assessment, 4(2), 145–155. https://doi.org/…3590.4.2.145
Torchiano, M. (2019). effsize: Efficient Effect Size Computation (R package version 0.7.6). https://doi.org/…nodo.1480624
Urbánek, T. (2010). Nejpoužívanější psychodiagnostické metody v České republice. TESTFÓRUM, 1(1), 6–9. https://doi.org/…7/TF2010-1-3
Wickham, H., & Bryan, J. (2019). readxl: Read Excel Files (R package version 1.3.1). https://cran.r-project.org/package=readxl
Wise, E. A., Streiner, D. L., & Walfish, S. (2010). A review and comparison of the reliabilities of the MMPI-2, MCMI-III, and PAI presented in their respective test manuals. Measurement and Evaluation in Counseling and Development, 42(4), 246–254. https://doi.org/…175609354594
Zumbo, B. D., Gadermann, A. M., & Zeisser, C. (2007). Ordinal versions of coefficients alpha and theta for likert rating scales. Journal of Modern Applied Statistical Methods, 6(1), 21–29. https://doi.org/…m/1177992180