Psychometric Properties of Controlled Oral Word Association (COWA) Test and Associations With Education and Bilingualism in Amer
Authors:
Journal: Assessment
Publication Type: Journal Article
Date: 2024
DOI: NIHMS1959924
ID: 37338127
Abstract
The Controlled Oral Word Association (COWA) test is used to assess phonemic fluency and executive function. Formal validation of test scores is important for accurate cognitive evaluation. However, there is a dearth of psychometric validation among American Indian adults. Given high burden of dementia risk and key contextual factors associated with cognitive assessments, this represents a critical oversight. In a large, longitudinal population-based cohort study of adult American Indians, we examined several validity inferences for COWA, including scoring, generalization, and extrapolation inferences, by investigation of factor structure, internal consistency, test-retest reliability, and differential test functioning. We found adequate unidimensional model fit, with high factor loadings. Internal consistency reliability and test-retest reliability were 0.88 and 0.77, respectively, for the full group. COWA scores were lowest among the oldest, lowest education, bilingual speakers; group effects for sex and bilingual status were small; age effect was medium; and education effect was largest. However, Wide Range Achievement Test (WRAT) score effect was stronger than education effect, suggesting better contextualization may be needed. These results support interpretation of total COWA score, including across sex, age, or language use strata.
Reference List
- Adesope OO, Lavin T, Thompson T, & Ungerleider C (2010). A systematic review and meta-analysis of the cognitive correlates of bilingualism. Review of Educational Research, 80(2), 207–245. 10.3102/0034654310368803|||Axelrod BN, & Henry RR (1992). Age-related performance on the Wisconsin card sorting, similarities, and controlled oral word association tests. Clinical Neuropsychologist, 6(1), 16–26. 10.1080/13854049208404113|||Baraldi AN, & Enders CK (2010). An introduction to modern missing data analyses. Journal of School Psychology, 48(1), 5–37. 10.1016/j.jsp.2009.10.001|||Barry D, Bates ME, & Labouvie E (2008). FAS and CFL forms of verbal fluency differ in difficulty: A meta-analytic study. Applied Neuropsychology, 15(2), 97–106. 10.1080/09084280802083863|||Bassuk SS, & Murphy JM (2003). Characteristics of the modified mini-mental state exam among elderly persons. Journal of Clinical Epidemiology, 56(7), 622–628. 10.1016/S0895-4356(03)00111-2|||Benjamini Y, & Hochberg Y (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289–300. 10.1111/j.2517-6161.1995.tb02031.x|||Benton AL, De Hamsher SK, & Sivan AB (1994). Multilingual aphasia examination (3rd. ed.). Psychological Assessment Resources.|||Bialystok E, Craik FI, & Freedman M (2007). Bilingualism as a protection against the onset of symptoms of dementia. Neuropsychologia, 45(2), 459–464. 10.1016/j.neuropsychologia.2006.10.009|||Bialystok E, Craik FI, & Luk G (2008). Lexical access in bilinguals: Effects of vocabulary size and executive control. Journal of Neurolinguistics, 21(6), 522–538.|||Bolla KI, Lindgren KN, Bonaccorsy C, & Bleecker ML (1990). Predictors of verbal fluency (FAS) in the healthy elderly. Journal of Clinical Psychology, 46(5), 623–628.10.1002/1097-4679(199009)46:5<623::aid-jclp2270460513>3.0.co;2-c|||Boone KB (1999). Neuropsychological assessment of executive functions: Impact of age, education, gender, intellectual level, and vascular status on executive test scores. In The human frontal lobes: Functions and disorders (pp. 247–260). Guilford Press.|||Brown TA (2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press.|||Browne MW, & Cudeck R (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258. 10.1177/0049124192021002005|||Casaletto KB, Umlauf A, Beaumont J, Gershon R, Slotkin J, Akshoomoff N, & Heaton RK (2015). Demographically corrected normative standards for the English version of the NIH toolbox cognition battery. Journal of the International Neuropsychological Society, 21(5), 378–391. 10.1017/S1355617715000351|||Centers for Disease Control and Prevention. (2019). Alzheimer’s disease and healthy aging. Subjective cognitive decline among American Indian/Alaska native adults. https://www.cdc.gov/aging/data/infographic/2017/american-Indian-alaska-native-cognitive-decline.html|||Cheng Y, Shao C, & Lathrop QN (2016). The mediated MIMIC model for understanding the underlying mechanism of DIF. Educational and Psychological Measurement, 76(1), 43–63. 10.1177/0013164415576187|||Cizek G, Rosenberg S, & Koons H (2008). Sources of validity evidence for educational and psychological tests. Educational and Psychological Measurement, 68, 397–412. 10.1177/0013164407310130|||Cole ER (2009). Intersectionality and research in psychology. American Psychologist, 64(3), 170–180. 10.1037/a0014564|||Costa A, Hernandez M, & Sebastian-Galles N (2008). Bilingualism aids conflict resolution: Evidence from the ANT task. Cognition, 106(1), 59–86. 10.1016/j.cognition.2006.12.013|||Craik FI, Bialystok E, & Freedman M (2010). Delaying the onset of Alzheimer disease: Bilingualism as a form of cognitive reserve. Neurology, 75(19), 1726–1729. 10.1212/WNL.0b013e3181fc2a1c|||Crane PK, Gruhl JC, Erosheva EA, Gibbons LE, McCurry SM, Rhoads K, & … White L (2010). Use of spoken and written Japanese did not protect Japanese-American men from cognitive decline in late life. Journal of Gerontology: Series B, 65(6), 654–666. 10.1093/geronb/gbq046|||Crenshaw KW (1989). Demarginalizing the intersection of race and sex: A Black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics. University of Chicago Legal Forum, 1989(1). Article 8.|||Enoch MA, & Albaugh BJ (2017). Review: Genetic and environmental risk factors for alcohol use disorders in American Indians and Alaskan Natives. American Journal of Addictions, 26(5), 461–468. 10.1111/ajad.12420|||Grace J, Nadler JD, White DA, Guilmette TJ, Giuliano AJ, Monsch AU, & Snow MG (1995). Folstein vs modified Mini-Mental State Examination in geriatric stroke. Stability, validity, and screening utility. Archives of Neurology, 52(5), 477–484. 10.1001/archneur.1995.00540290067019|||Harvey J, & Siegert RJ (1999). Normative data for New Zealand elders on the controlled oral word association test, graded naming test, and the recognition memory test. New Zealand Journal of Psychology, 28, 124.|||Jack AS, & Secwepemc Cultural Education Society. (2000). Behind closed doors: Stories from the Kamloops Indian Residential School. Secwepemc Cultural Education Society.|||Kane MT (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. 10.1111/jedm.12000|||Kenny DA, Kaniskan B, & McCoach DB (2015). The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research, 44, 486–507. 10.1177/0049124114543236|||Kiselica AM, Johnson E, Lewis KR, & Trout K (2021). Examining racial disparities in the diagnosis of mild cognitive impairment. Applied Neuropsychology: Adult. Advance online publication. 10.1080/23279095.2021.1976778|||Lakens D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Frontier in Psychology, 4, Article 863. 10.3389/fpsyg.2013.00863|||Lee ET, Welty TK, Fabsitz R, Cowan LD, Le NA, Oopik AJ, & … Howard BV (1990). The Strong Heart Study a study of cardiovascular disease in American Indians: Design and methods. American Journal of Epidemiology, 132(6), 1141–1155. 10.1093/oxfordjournals.aje.a115757|||Lenhard W, & Lenhard A (2016). Computation of effect sizes. 10.13140/RG.2.2.17823.92329|||Lezak MD (2012). Neuropsychological assessment (5th ed.). Oxford University Press.|||Libon DJ, Glosser G, Malamut BL, Kaplan E, Goldberg E, Swenson R, & Prouty Sands L (1994). Age, executive functions, and visuospatial functioning in healthy older adults. Neuropsychology, 8(1), 38–43. 10.1037/0894-4105.8.1.38|||Lissitz RW (2009). The concept of validity: Revisions, new directions, and applications. Information Age.|||Little RJA (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202. 10.1080/01621459.1988.10478722|||Liu H, & Wu L (2021). Lifelong bilingualism functions as an alternative intervention for cognitive reserve against Alzheimer’s disease. Frontiers in Psychiatry, 12, Article 696015. 10.3389/fpsyt.2021.696015|||Lomawaima KT, & McCarty TL (2006). Table of contents for ‘‘To remain an Indian’’: Lessons in democracy from a century of Native American education. Teachers College Press. http://www.loc.gov/catdir/toc/fy0702/2006043864.html|||Loonstra AS, Tarlow AR, & Sellers AH (2001). COWAT metanorms across age, education, and gender. Applied Neuropsychology, 8(3), 161–166. 10.1207/S15324826AN0803_5|||Lynch PDCM (1990). The emergence of American Indian leadership in education. Journal of American Indian Education, 29, 1–10.|||Manly JJ, Jacobs DM, Sano M, Bell K, Merchant CA, Small SA, & Stern Y (1998). Cognitive test performance among nondemented elderly African Americans and Whites. Neurology, 50(5), 1238–1245. 10.1212/wnl.50.5.1238|||McDonald RP (1999). Test theory: A unified treatment. Lawrence Erlbaum.|||McDowell I, Kristjansson B, Hill GB, & Hébert R (1997). Community screening for dementia: The Mini Mental State Exam (MMSE) and modified Mini-Mental State Exam (3MS) compared. Journal of Clinical Epidemiology, 50(4), 377–383. 10.1016/S0895-4356(97)00060-7|||Mehta KM, & Yeo GW (2017). Systematic review of dementia prevalence and incidence in United States race/ethnic populations. Alzheimers Dementia, 13(1), 72–83. 10.1016/j.jalz.2016.06.2360|||Mervis J. (2009). Informal education: Report calls for fresh look at what happens outside school. Science, 323(5914), 572–573. 10.1126/science.323.5914.572a|||Muthén BO (1989). Latent variable modeling in heterogeneous populations. Psychometrika, 54, 557–585.|||Muthén BO (1998-2004). Mplus technical appendices.|||Nunnally JC, & Bernstein IH (1994). Psychometric theory. McGraw-Hill.|||Pedraza O, Clark JH, O’Bryant SE, Smith GE, Ivnik RJ, Graff-Radford NR, & … Lucas JA (2012). Diagnostic validity of age and education corrections for the Mini-Mental State Examination in older African Americans. Journal of the American Geriatricks Society, 60(2), 328–331. 10.1111/j.1532-5415.2011.03766.x|||Prior AMB (2010). A bilingual advantage in task switching. Bilingualism: Language and Cognition, 13(2), 253–262. 10.1017/S1366728909990526|||Rivera Mindt M, Byrd D, Saez P, & Manly J (2010). Increasing culturally competent neuropsychological services for ethnic minority populations: A call to action. The Clinical Neuropsychologist, 24(3), 429–453. 10.1080/13854040903058960|||Rodriguez-Aranda C, & Martinussen M (2006). Age-related differences in performance of phonemic verbal fluency measured by Controlled Oral Word Association Task (COWAT): A meta-analytic study. Developemental Neuropsychology, 30(2), 697–717. 10.1207/s15326942dn3002|||Rosenthal L. (2016). Incorporating intersectionality into psychology: An opportunity to promote social justice and equity. American Psychologist, 71(6), 474–485. 10.1037/a0040323|||Ruff RM, Light RH, Parker SB, & Levin HS (1996). Benton controlled oral word association test: Reliability and updated norms. Archives of Clinical Neuropsychology, 11(4), 329–338. https://www.ncbi.nlm.nih.gov/pubmed/14588937
|||Running Bear U, Thayer ZM, Croy CD, Kaufman CE, Manson SM, & Team A-S (2019). The impact of individual and parental American Indian boarding school attendance on chronic physical health of northern plains tribes. Family and Community Health, 42(1), 1–7. 10.1097/FCH.0000000000000205|||Sayegh P, Arentoft A, Thaler NS, Dean AC, & Thames AD (2014). Quality of education predicts performance on the Wide Range Achievement Test-4th Edition word reading subtest. Archives of Clinical Neuropsychology, 29(8), 731–736. 10.1093/arclin/acu059|||Saykin AJ, Gur RC, Gur RE, Shtasel DL, Flannery KA, Mozley LH, & … Mozley PD (1995). Normative neuropsychological test performance: Effects of age, education, gender and ethnicity. Applied Neuropsychology, 2(2), 79–88. 10.1207/s15324826an0202_5|||Scribner S, & Cole M (1973). Cognitive consequences of formal and informal education: New accommodations are needed between school-based learning and learning experiences of everyday life. Science, 182(4112), 553–559. 10.1126/science.182.4112.553|||Selnes OA, Jacobson L, Machado AM, Becker JT, Wesch J, Miller EN, & … McArthur JC (1991). Normative data for a brief neuropsychological screening battery. Multicenter AIDS cohort study. Perceptual and Motor Skills, 73(2), 539–550. 10.2466/pms.1991.73.2.539|||Settles IH, O’Connor RC, & Yap SCY (2016). Climate perceptions and identity interference among undergraduate women in STEM: The protective role of gender identity. Psychology of Women Quarterly, 40(4), 488–503. 10.1177/0361684316655806|||Shi D, DiStefano C, Maydeu-Olivares A, & Lee T (2022). Evaluating SEM model fit with small degrees of freedom. Multivariate Behavioral Research, 57(2–3), 179–207. 10.1080/00273171.2020.1868965|||Suchy-Dicey AM, Eyituoyo H, O’Leary M, Cole SA, Traore A, Verney S, & … Whitney P (2022). Psychological and social support associations with mortality and cardiovascular disease in middle-aged American Indians: The Strong Heart Study. Social Psychiatry and Psychiatric Epidemiology, 57(7), 1421–1433. 10.1007/s00127-022-02237-7|||Suchy-Dicey AM, Howard B, Longstreth WT Jr., Reiman EM, & Buchwald D (2022). APOE genotype, hippocampus, and cognitive markers of Alzheimer’s disease in American Indians: Data from the Strong Heart Study. Alzheimers Dementia, 18, 2518–2526. 10.1002/alz.12573|||Suchy-Dicey AM, Muller CJ, Madhyastha TM, Shibata D, Cole SA, Zhao J, & … Buchwald D (2018). Telomere length and magnetic resonance imaging findings of vascular brain injury and central brain atrophy: The Strong Heart Study. American Journal of Epidemiology, 187(6), 1231–1239. 10.1093/aje/kwx368|||Suchy-Dicey AM, Muller CJ, Shibata D, Howard BV, Cole SA, Longstreth WT Jr., & … Buchwald D (2021). Comparing vascular brain injury and stroke by cranial magnetic resonance imaging, physician-adjudication, and self-report: Data from the Strong Heart Study. Neuroepidemiology, 55(5), 398–406. 10.1159/000517804|||Suchy-Dicey AM, Oziel K, Sawyer C, Olufadi Y, Ali T, Fretts AM, Umans JG, Shibata DK, Longstreth WT, Rhoads K, & Buchwald DS, (2022). Educational and clinical associations with longitudinal cognitive function and brain imaging in American Indians: The Strong Heart Study. Neurology, 99(24), e2637–e2647. 10.1212/WNL.0000000000201261|||Suchy-Dicey AM, Shibata D, Best LG, Verney SP, Longstreth WT Jr., Lee ET, & … Buchwald D (2016). Cranial magnetic resonance imaging in elderly American Indians: Design, methods, and implementation of the Cerebrovascular disease and its consequences in American Indians study. Neuroepidemiology, 47(2), 67–75. 10.1159/000443277|||Suchy-Dicey AM, Shibata D, Cholerton B, Nelson L, Calhoun D, Ali T, & … Verney SP (2020). Cognitive correlates of MRI-defined cerebral vascular injury and atrophy in elderly American Indians: The Strong Heart Study. Journal of the International Neuropsychological Society, 26(3), 263–275. 10.1017/S1355617719001073|||Suchy-Dicey AM, Verney SP, Nelson LA, Barbosa-Leiker C, Howard BA, Crane PK, & Buchwald DS (2020). Depression symptoms and cognitive test performance in older American Indians: The Strong Heart Study. Journal of the American Geriatrics Society, 68(8), 1739–1747. 10.1111/jgs.16434|||Tombaugh TN, Kozak J, & Rees L (1999). Normative data stratified by age and education for two measures of verbal fluency: FAS and animal naming. Archives of Clinical Neuropsychology, 14(2), 167–177. https://www.ncbi.nlm.nih.gov/pubmed/14590600
|||Tombaugh TN, McDowell I, Kristjansson B, & Hubley AM (1996). Mini-Mental State Examination (MMSE) and the Modified MMSE (3MS): A psychometric comparison and normative data. Psychological Assessment, 8(1), 48–59. 10.1037/1040-3590.8.1.48|||Veizel K, & Zibulsky J (2013). Wide range achievement test–fourth edition. In Reynolds CR, Vannest KJ, & Fletcher-Janzen E (Eds.), Encyclopedia of special education: A reference for the education of children, adolescents, and adults with disabilities and other exceptional individuals. Wiley.|||Verney SP, Suchy-Dicey AM, Cholerton B, Calhoun D, Nelson L, Montine TJ, & … Buchwald D (2019). The associations among sociocultural factors and neuropsychological functioning in older American Indians: The Strong Heart Study. Neuropsychology, 33(8), 1078–1088. 10.1037/neu0000574|||Widaman KF (2006). Best practices in quantitative methods for developmentalists: III. Missing data: What to do with or without them. Monographs of the Society for Research in Child Development, 71(3), 42–64. 10.1111/j.1540-5834.2006.00404.x|||Zahodne LB, Manly JJ, Smith J, Seeman T, & Lachman ME (2017). Socioeconomic, health, and psychosocial mediators of racial disparities in cognition in early, middle, and late adulthood. Psychology and Aging, 32(2), 118–130. 10.1037/pag0000154|||Zahodne LB, Sharifian N, Kraal AZ, Zaheed AB, Sol K, Morris EP, & … Brickman AM (2021). Socioeconomic and psychosocial mechanisms underlying racial/ethnic disparities in cognition among older adults. Neuropsychology, 35(3), 265–275. 10.1037/neu0000720|||Zhang Y, Galloway JM, Welty TK, Wiebers DO, Whisnant JP, Devereux RB, & … Lee ET (2008). Incidence and risk factors for stroke in American Indians: The Strong Heart Study. Circulation, 118(15), 1577–1584. 10.1161/CIRCULATIONAHA.108.772285