Published on 10.02.14 in Vol 3, No 1 (2014): Jan-Mar
Health Literacy Association With Health Behaviors and Health Care Utilization in Multiple Sclerosis: A Cross-Sectional Study
Background: Low health literacy is generally associated with poor health outcomes; however, health literacy has received little attention in multiple sclerosis (MS).
Objective: The aim of this study was to investigate the health literacy of persons with MS
using the North American Research Committee on Multiple Sclerosis (NARCOMS) Registry.
Methods: In 2012, we conducted a cross-sectional study of health literacy among NARCOMS participants. Respondents completed the Medical Term Recognition Test (METER) which assesses the ability to distinguish medical and nonmedical words, and the Newest Vital Sign (NVS) instrument which evaluates reading, interpretation, and numeracy skills. Respondents reported their sociodemographic characteristics, health behaviors, comorbidities, visits to the emergency room (ER), and hospitalizations in the last 6 months. We used logistic regression to evaluate the characteristics associated with functional literacy, and the association between functional literacy and health care utilization.
Results: Of 13,020 eligible participants, 8934 (68.6%) completed the questionnaire and were US residents. Most of them performed well on the instruments with 81.04% (7066/8719) having functional literacy on the METER and 74.62% (6666/8933) having adequate literacy on the NVS. Low literacy on the METER or the NVS was associated with smoking, being overweight or obese (all P<.001). After adjustment, low literacy on the METER was associated with ER visits (OR 1.28, 95% CI 1.10-1.48) and hospitalizations (OR 1.19, 95% CI 0.98-1.44). Findings were similar for the NVS.
Conclusions: In the NARCOMS cohort, functional health literacy is high. However, lower levels of health literacy are associated with adverse health behaviors and greater health care utilization.
Interact J Med Res 2014;3(1):e3)
The elements of general literacy include the knowledge and skills to comprehend and use written information, to locate and use information captured in documents such as maps, and numeracy. Health literacy builds on these concepts , and refers to the capacity of individuals to gather, process, and comprehend the basic health information and services needed to support health-related decision making. Individuals need to be able to understand written health information and to communicate verbally about health, so that they can make decisions about health promotion, health protection, disease prevention, health care maintenance, and to navigate the health care system [ ].
A growing literature suggests that lower health literacy is associated with higher rates of health care utilization and mortality, lower rates of health promoting activities, lower adherence to therapy and less successful disease control [, - ]. Despite this recognition in other populations, and the frequent interactions with the health system required by affected people [ , ], the issue of health literacy has received little attention in multiple sclerosis (MS) population [ ].
We aimed to investigate the health literacy of persons with MS in a sociodemographically diverse population from the United States, and to estimate the associations between health literacy and health behaviors, comorbidities, and health care utilization. We hypothesized that lower health literacy would be associated with a higher frequency of smoking, obesity, and greater health care utilization.
North American Research Committee on Multiple Sclerosis Registry
The North American Research Committee on Multiple Sclerosis (NARCOMS) Registry is a voluntary self-report registry for people with MS, developed by the Consortium of MS Centers . We have validated diagnoses of MS in a randomly selected sample of participants [ ]. NARCOMS participants agree to the use of their de-identified data for research purposes, and the Registry is approved by the Institutional Review Board at the University of Alabama at Birmingham.
Participants may enroll by completing a questionnaire online, or by mailing in a questionnaire . After enrollment, participants are asked to complete surveys semi-annually, on paper or online per their preference. On each survey participants report sociodemographic and clinical information, including disability status using Patient Determined Disease Steps (PDDS) and Performance Scales (PS) [ , ]. The PDDS is a validated measure which correlates highly with a physician-scored Expanded Disability Status Scale (EDSS) [ , ]. It is scored ordinally from 0 to 8, where a score of 0 approximates an EDSS score of 0, a score of 3 represents early gait disability without needing an assistive device and approximates an EDSS score of 4.0 to 4.5; and scores of 4, 5, and 6 represent EDSS scores of 6.0 to 6.5. PS uses a single question to assess eight domains, including mobility, bowel/bladder, fatigue, sensory, vision, cognition, spasticity, and hand [ ]. All of the subscales are scored as follows: 0 (normal), 1 (minimal), 2 (mild), 3 (moderate), 4 (severe), or 5 (total disability), except mobility which is scored from 0 to 6. The cognition subscale correlates strongly with the Perceived Deficits Questionnaire (r=.71, P<.001) [ ], a 20-item self-reported questionnaire for cognition incorporated in the Multiple Sclerosis Quality of Life Inventory [ ]. Construct validity of the cognitive subscale is supported by moderate correlations (r=.70, P<.001) with the Modified Fatigue Impact Scale (convergent validity) but not with age (r=.11, P=.46, divergent validity) [ ].
Participants report the presence or absence of specific comorbidities using the following question format “Has a doctor ever told you that you have…?”. We have previously shown the validity of our self-reported comorbidity questionnaire [ ]. Based on our prior work, the comorbidities of interest were diabetes, hypertension, hyperlipidemia, heart disease, migraine, irritable bowel syndrome, chronic lung disease, cancer, obstructive sleep apnea, autoimmune thyroid disease, depression, and anxiety [ , ].
Current smoking status is assessed using a validated question from the Behavioral Risk Factor Surveillance System, and reported as none, some days or every day . We assess the frequency of alcohol intake in the prior 6 months with the first question from the AUDIT-C, a screening instrument developed to identify persons with recent heavy drinking and alcohol dependence [ ]. Responses are never, monthly or less, two to four times a month, three to four times a week, and four or more times a week. Body mass index (BMI) is calculated from self-reported height and weight. Overweight is defined as BMI≥25 and BMI<30, and obesity as BMI≥30 [ ].
With respect to health care utilization in the last 6 months, participants report whether they had any visits to an emergency room (ER), and whether they were hospitalized overnight.
We asked NARCOMS participants about health literacy in 2012. Multiple generic health literacy instruments have been developed . We selected three instruments validated in other populations based on several considerations. First, no instrument fully captures the construct of health literacy as defined by a person’s ability to seek, understand, and use health information [ ]; thus multiple instruments were needed. Second, we selected instruments that were brief and easy to administer to minimize participant burden. We used the eHealth Literacy Scale (eHEALS) which includes eight items that assess the knowledge, comfort and perceived skills of persons completing the scale, who are seeking and using electronic health information to address health concerns. It also includes two optional questions designed to assess the participant’s interest in using e-health tools. The instrument was developed based on social cognitive and self-efficacy theory. It has been validated and showed good internal consistency (alpha=.88) and test-retest reliability [ ].
The Medical Term Recognition Test (METER) is a brief, self-administered questionnaire that was developed to address other instruments’ limitations such as excessive length, or the requirement that a practitioner administers the tool. The METER is composed of 40 medical words and 30 nonwords . The respondent is asked to mark the words they recognize as actual words, and the METER is scored as the number of correctly identified words minus the number of incorrectly identified words. According to the developers, the format of the instrument was based on tests such as the Author Recognition Test and other similar tests which correlate highly with measures of vocabulary, reading comprehension, and verbal fluency. Scores of 0-20 indicate low literacy, 21-34 indicate marginal literacy, and 35-40 indicate functional literacy. The instrument has high internal consistency (alpha=.93), which correlates highly with the Rapid Estimate of Adult Literacy in Medicine (REALM) questionnaire (r=.74), an interviewer-administered measure of literacy, and is associated with cardiovascular health.
The Newest Vital Sign (NVS) Instrument is a nutrition label from an ice cream container that is accompanied by six questions aimed to test reading, interpretation, and numeracy skills . For example one question asks how many calories would be consumed if an entire container were eaten, while another asks whether it is safe for a person with peanut allergy to eat the ice cream. One point is scored for each correct answer. Scores from 0-1 suggest a high likelihood of marginal or inadequate literacy; 2-3 suggest possible marginal or inadequate literacy, while scores of 4-6 indicate adequate literacy. The NVS requires about three minutes for administration. Scores of less than 4 suggest low health literacy. The internal consistency of the instrument is good (alpha=.76), and it has good criterion validity as compared to the Test of Functional Health Literacy in Adults (TOFLHA).
We restricted our analysis to NARCOMS participants living in the United States. Missing responses were not imputed. Performance on each of the instruments was scored as described above.
Given that the three instruments used to assess health literacy have not been used in the MS population previously, we also report the internal consistency for the two multi-item instruments (NVS, eHEALS) as measured using Cronbach’s alpha . We summarized categorical variables using frequency (percent [%]), and continuous variables using mean (standard deviation [SD]) or median (interquartile range [IQR]) as appropriate.
After categorizing the scores for the METER and NVS as described above, we estimated the associations between health literacy and health behaviors, comorbidity, and health care utilization. Health behaviors included current smoking (yes vs no), overweight or obesity versus normal weight, any alcohol intake (yes vs no). Comorbidity was evaluated as any comorbidity versus no comorbidity, and as the number of comorbidities. Health care utilization included ER visits (yes vs no) and hospitalizations (yes vs no). Univariate analyses employed chi-square tests.
Multivariable analyses employed binary logistic regression. For these analyses we dichotomized the METER at the cutpoint for functional literacy (≤34 [low literacy] vs >35 [functional literacy]), and the NVS at the cutpoint for adequate literacy (<4 [low literacy] vs ≥4 [adequate literacy]). First we evaluated the association between participant characteristics and having functional/adequate literacy. We constructed separate models for the METER and the NVS. Second, we separately modeled the association of health literacy with the outcomes of any ER visits and any hospitalizations. The independent variables considered for each regression model are described below.
For gender, female was the reference category. Race was categorized as white (reference group), and nonwhite. Education was included as indicator variables for high school diploma or less (reference group), Associate’s Degree or Technical Degree, Bachelor’s Degree, and post-graduate degree. Annual household income was included as indicator variables for <$15,000 (reference group), $15,000-29,999, $30,000-49,999, $50,000-100,000, and >$100,000, or declined to answer. Insurance status was included as indicator variables for private, public only (reference group), or none. Age was categorized as ≤35 (reference group), >35 to ≤50, >50 to ≤65, and >65 years. Using PDDS, participants were classified as having mild (0-2), moderate (3-4), or severe (5-8, reference group) disability . Using PS cognition subscale, participants were classified as having normal (0, reference group), mildly impaired (1-2), or moderately to severely (3-5) impaired cognition.
Assumptions of models were tested using standard methods . For each logistic regression model we used adjusted odds ratios (OR) and 95% confidence intervals (CI) as measures of association. We report a c-statistic as a measure of discriminating ability (estimate of area under the curve) and the Hosmer Lemeshow test as a measure of goodness of fit. Analyses were performed using SAS V9.2 (SAS Institute Inc, Cary, NC).
Of 13,020 eligible participants, 9019 (69.27%) completed the spring 2012 questionnaire. As compared to responders, nonresponders were more likely to be nonwhite (P<.001), to have a lower level of education (P<.001) and lower annual income (P=.007). They did not differ with respect to gender. Nonresponders were slightly younger (mean 53.70, SD 11.69) than responders (mean 57.02, SD 10.39, P<.001). Mean age at onset of MS symptoms was also younger in nonresponders (mean 30.12, SD 9.99) than responders (mean 30.97, SD 10.04, P<.001), but the difference of less than a year is unlikely to be clinically relevant. Of those who completed the questionnaire, 8934 (99.06%) were US residents and were included in this analysis. The demographic and clinical characteristics of the responders are summarized in.
Electronic Health Information and Health Literacy
The internal consistency reliability of the NVS was .74, and of the eHEALS was .94. Most respondents performed well on the health literacy instruments. On the METER, 1.84% (160/8719) had low literacy, 17.12% (1493/8719) had marginal literacy, and 81.04% (7066/8719) had functional literacy. On the NVS, 10.81% (966/8933) of respondents had a high likelihood of inadequate literacy, 14.56% (2267/8933) possibly had inadequate literacy, while 74.62% (6666/8933) had adequate literacy. Only 1.03% (90/8718) of participants had low literacy on both the METER and the NVS, while 65.52% (5712/8718) had functional literacy/numeracy on both instruments. METER scores correlated weakly with NVS scores (r=.31, P<.001).
The mean (SD) score on the eHEALS was 28.15 (18.57). eHEALS scores correlated quite weakly with scores on the METER (r=.14, P<.001) and the NVS (r=.24, P<.001). The mean (SD) eHEALS score was lower among persons with low literacy on the METER (mean 16.89, SD 16.86) than among persons with functional literacy (mean 29.24, SD 18.35, P<.001). Similarly, the mean (SD) eHEALS score was lower among persons with a high likelihood of inadequate literacy on the NVS (mean 17.36, SD 17.22) than among persons with adequate literacy (mean 30.40, SD 18.02, P<.001).
On univariate analysis, several sociodemographic characteristics were associated with functional health literacy (and ). When assessed using the METER and the NVS, women, respondents with a higher level of education, higher level of income, and private health insurance were more likely to have functional literacy. Lower levels of self-reported disability and cognitive impairment, and shorter disease duration were also associated with an increased frequency of functional literacy based on the METER and the NVS.
Using multivariable logistic regression, gender (females), higher levels of education, higher levels of income, and older age, were associated with higher odds of having functional health literacy as assessed by the METER (). Higher levels of cognitive impairment were associated with lower odds of functional literacy. When literacy was assessed using the NVS, the findings were similar with the exception that higher levels of disability, as measured by the PDDS, were also associated with decreased odds of adequate literacy.
Comorbidities and Health Behaviors
In total, 6973 (78.05%) of 8934 participants reported one or more comorbid conditions with 2868 (32.1%) reporting hypertension, 3328 (37.25%) depression, 2804 (31.39%) hyperlipidemia, 1413 (15.82%) migraine, 1152 (12.89%) autoimmune thyroid disease, and 1032 (11.55%) reporting cancer. The remaining comorbidities were reported by fewer than 10% of respondents. Most respondents did not smoke currently (7708/8811, 87.48%) and 3061/8797 (34.78%) denied any alcohol consumption. The mean (SD) BMI of respondents was 26.93 (6.48), with 2625/8741 (30.03%) being overweight and 2239/8741 (25.61%) being obese.
The proportion of respondents with any comorbidity was slightly higher among those with greater health literacy on the METER (Z=-1.81, P=.07 for linear trend) and on the NVS (Z=-5.57, P<.001 for linear trend). Respondents who reported being nonsmokers were more likely to have functional literacy on the METER and adequate literacy on the NVS than smokers (both P<.001,). However, the frequency of any alcohol consumption was higher among respondents with higher health literacy than among those with lower health literacy as measured by the METER and the NVS (both P<.001, ). Overweight and obesity were more common among those with lower health literacy (METER P=.006; NVS P=.007).
Health Care Utilization
During 6 months prior to survey administration, 1275/8807 (14.48%) respondents presented to an emergency room and 831/8792 (9.45%) were hospitalized. Participants were less likely to report an ER visit (P=.002) or hospitalization (P<.001) if they had higher literacy on the METER (, Figure 1A). Similarly, participants were less likely to report an ER visit or hospitalization if they had adequate literacy on the NVS (both P<.001, , Figure 1B).
In an unadjusted logistic regression model, low literacy on the METER was associated with 28% increased odds of any ER visit (OR 1.28; 95% CI 1.11-1.48). In a multivariable logistic regression model adjusting for income, disability, and cognitive impairment, low literacy on the METER was associated with 13% increased odds of any ER visit (OR 1.13; 95% CI 0.96-1.33) ().
In an unadjusted logistic regression model, low literacy on the NVS was associated with 58% increased odds of any ER visit (OR 1.58; 95% CI 1.39-1.79). In a multivariable model adjusting for income, disability, and cognitive impairment, low literacy on the NVS was still associated with increased odds of any ER visit (OR 1.28; 95% CI 1.10-1.48) ().
In an unadjusted logistic regression model, low literacy on the METER was associated with 28% increased odds of any overnight hospitalization (OR 1.28; 95% CI 1.11-1.48). In a multivariable logistic regression model adjusting for gender, income, disability and cognitive impairment, low literacy on the METER was associated with 19% increased odds of any hospitalization (OR 1.19; 95% CI 0.98-1.44) ().
In an unadjusted logistic regression model, low literacy on the NVS was associated with 58% increased odds of any overnight hospitalization (OR 1.58; 95% CI 1.36-1.85). In a multivariable logistic regression model, low literacy on the NVS was associated with 17% increased odds of any hospitalization (OR 1.17; 95% CI 0.97-1.40) ().
We investigated health literacy in a sociodemographically diverse population of persons with MS. We found that 65.52% of respondents had functional health literacy on both the METER and the NVS. Furthermore, functional literacy was associated with greater comfort and perceived skill at using electronic health information as assessed using eHEALS. Although most respondents performed well on the METER and the NVS instruments, lower health literacy was associated with an increased risk of smoking, overweight and obesity, comorbidity, visits to the emergency room and overnight hospitalizations.
As assessed by the METER, 81% of the NARCOMS population had functional literacy while nearly 75% had adequate literacy as assessed by the NVS; the latter instrument has a greater emphasis on numeracy. We were unable to identify other studies which have evaluated this issue in MS. Findings varied in other chronic diseases. Approximately 70% of individuals diagnosed with COPD have functional health literacy , as compared to 88% in persons with rheumatoid arthritis, and 82.5-85% in persons with heart disease [ , ].
Sociodemographic characteristics associated with greater odds of having functional health literacy included females, older age, higher socioeconomic status, normal self-reported cognition, and lower levels of disability. The association of socioeconomic status and health literacy is consistent across populations, including those with heart failure , chronic obstructive pulmonary disease [ ], and rheumatoid arthritis [ ], among others. In some populations older age is associated with lower rather than higher health literacy, and the association of age with health literacy also varies with the instrument used [ , ]. As we found in our population, lower health literacy is associated with worse health status [ ]. This is a complicated issue to understand in MS where cognitive impairment may develop over the course of the disease and could lead to declines in health literacy. Longitudinal studies will be needed to determine the directionality of these relationships in MS.
Lower health literacy was associated with a greater frequency of smoking and obesity, but a lower frequency of regular alcohol use and comorbidity. Findings in other populations regarding these associations have been inconsistent . Our findings may reflect unmeasured confounders, differential health behaviors according to health literacy, or differential reporting according to health literacy. Persons with lower health literacy have less knowledge of chronic diseases, and we speculate that they may not report comorbidity as accurately. These findings will require further evaluation in future studies. Respondents who did not have functional health literacy had increased odds of emergency room visits, after accounting for potential confounders. This association was stronger for the NVS (OR 1.28; 95% CI 1.10-1.48), which captures numeracy, than for the METER (OR 1.13; 95% CI 0.96-1.33). Similarly, respondents who did not have functional health literacy had increased odds of hospitalization although these associations were marginally nonsignificant for the METER (OR 1.19; 95% CI 0.98-1.44) and the NVS (OR 1.17; 95% CI 0.97-1.40). Lower health literacy is consistently associated with greater health care utilization in other populations, although the magnitude of the association varies across populations and outcomes studied [ ].
The response rate was 69.27% and responders were more likely to be white and to have a higher annual income; thus, our findings may not be applicable to nonwhites and those of lower socioeconomic status. The NARCOMS population does not fully represent the MS population in the United States, but its characteristics are similar to those reported for other MS populations [, ]. Furthermore, it is a large, sociodemographically diverse population comprised of participants who receive care in community-based and academic centers. The NVS was not designed to be self-administered; however, it has been successfully self-administered in other studies [ ]. None of the health literacy measures used was ideal, and the literature does not provide a clear understanding of the relationships between them. In their critical appraisal of health literacy tools, Jordan et al found that no existing instrument fully measured health literacy with respect to the person’s ability to seek, understand, and use health information [ ]. Moreover, construct validity was variable and the sensitivity to change of most instruments has not been evaluated. These challenges are supported by the relatively weak correlations among the three instruments used in this study. At least one study has raised concerns about the validity of the eHEALS due to low correlations with internet use [ ]. Although we included a measure of cognition, it is unlikely that this fully accounted for cognitive impairment, given the complex relationships between subjective and objective measures of cognition [ ]. Because this was an initial study evaluating health literacy, the design was cross-sectional, limiting our ability to assess causal relationships between health literacy and the outcomes of interest.
Health literacy is under-studied in MS. Our findings suggest that it is associated with adverse health behaviors, and increased health care utilization. Future work should seek to develop better methods of defining and assessing health literacy in MS population, confirm these findings, elucidate causal pathways, examine a broader range of health outcomes including adherence to therapy, and ultimately, evaluate the impact of interventions aimed at improving health literacy in the MS population.
The NARCOMS Registry is supported (in part) by the Consortium of Multiple Sclerosis Centers. This project was supported in part by a Don Paty Career Development Award from the MS Society of Canada (to RAM). The sponsors had no role in the design or conduct of the study; the interpretation or analysis of the data; or in the decision to submit for publication.
Conflicts of Interest
Ruth Ann Marrie receives research funding from: Canadian Institutes of Health Research, Public Health Agency of Canada, Manitoba Health Research Council, Health Sciences Centre Foundation, Multiple Sclerosis Society of Canada, Multiple Sclerosis Scientific Foundation, Rx & D Health Research Foundation, and has conducted clinical trials funded by Sanofi-Aventis.
Amber Salter has no conflicts of interest to declare.
Tuula Tyry has no conflicts of interest to declare.
Robert Fox has received personal consulting fees from Avanir, Biogen Idec, Novartis, Questcor, and Teva Neurosciences; has served on clinical trial advisory committees for Biogen Idec and Novartis; has received research support from the National Multiple Sclerosis Society (RG 4091A3/1; RG 4103A4/2; RC 1004-A-5) and Novartis; and serves on the editorial boards of Neurology and Multiple Sclerosis Journal.
Gary Cutter has served on scientific advisory boards for and/or received funding for travel from Alexion, Allozyne,Bayer, Celgene, Consortium of MS Centers, Coronado Biosciences, Diogenix, Klein-Buendel Incorporated, Merck, Novartis, Nuron Biotech, Receptos, Somnus Pharmaceuticals, Spinifex Pharmaceuticals, St. Louis University, Teva pharmaceuticals; receives royalties from publishing Evaluation of Health Promotion and Disease Prevention (The McGraw Hill Companies, 1984); has received honoraria from GlaxoSmithKline, Novartis, Advanced Health Media Inc., Biogen Idec, EMD Serono Inc., EDJ Associates, Inc., the National Heart, Lung, and Blood Institute, National Institute of Neurological Diseases and Stroke, National Marrow Donor Program, Consortium of Multiple Sclerosis Centers; serves as a consultant to Novartis, National Industrial Sand Association, Bayer Pharmaceuticals, and Teva Pharmaceuticals Industries Ltd.; has served on independent data and safety monitoring committees for Apotek, Biogen, Cleveland Clinic, EliLilly, Glaxo Smith Klein Pharmaceuticals, Medivation, Modigenetech, NHLBI, NINDS, NMSS, Ono Pharmaceuticals, Prolor, Sanofi-Aventis, Teva.
Multimedia Appendix 1
Frequency of health behaviours and health care utilization according to health literacy scores.PDF File (Adobe PDF File), 35KB
- Baker DW, Gazmararian JA, Williams MV, Scott T, Parker RM, Green D, et al. Functional health literacy and the risk of hospital admission among Medicare managed care enrollees. Am J Public Health 2002 Aug;92(8):1278-1283. [Medline]
- Baker DW. The meaning and the measure of health literacy. J Gen Intern Med 2006 Aug;21(8):878-883 [FREE Full text] [CrossRef] [Medline]
- Peterson PN, Shetterly SM, Clarke CL, Bekelman DB, Chan PS, Allen LA, et al. Health literacy and outcomes among patients with heart failure. JAMA 2011 Apr 27;305(16):1695-1701. [CrossRef] [Medline]
- Vastag B. Low health literacy called a major problem. JAMA 2004 May 12;291(18):2181-2182. [CrossRef] [Medline]
- Sudore RL, Mehta KM, Simonsick EM, Harris TB, Newman AB, Satterfield S, et al. Limited literacy in older people and disparities in health and healthcare access. J Am Geriatr Soc 2006 May;54(5):770-776. [CrossRef] [Medline]
- Baker DW, Wolf MS, Feinglass J, Thompson JA, Gazmararian JA, Huang J. Health literacy and mortality among elderly persons. Arch Intern Med 2007 Jul 23;167(14):1503-1509. [CrossRef] [Medline]
- Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med 2011 Jul 19;155(2):97-107. [CrossRef] [Medline]
- Baker DW, Gazmararian JA, Williams MV, Scott T, Parker RM, Green D, et al. Functional health literacy and the risk of hospital admission among Medicare managed care enrollees. Am J Public Health 2002 Aug;92(8):1278-1283. [Medline]
- Pohar SL, Jones CA, Warren S, Turpin KV, Warren K. Health status and health care utilization of multiple sclerosis in Canada. Can J Neurol Sci 2007 May;34(2):167-174. [Medline]
- Chiovetti A. Bridging the gap between health literacy and patient education for people with multiple sclerosis. J Neurosci Nurs 2006 Oct;38(5):374-378. [Medline]
- Consortium of Multiple Sclerosis Centers. NARCOMS Multiple Sclerosis Registry URL: http://www.narcomsorg/about [accessed 2014-01-21] [WebCite Cache]
- Marrie RA, Cutter G, Tyry T, Campagnolo D, Vollmer T. Validation of the NARCOMS registry: diagnosis. Mult Scler 2007 Jul;13(6):770-775. [CrossRef] [Medline]
- Marrie RA, Goldman M. Validity of performance scales for disability assessment in multiple sclerosis. Mult Scler 2007 Nov;13(9):1176-1182. [CrossRef] [Medline]
- Schwartz CE, Vollmer T, Lee H. Reliability and validity of two self-report measures of impairment and disability for MS. North American Research Consortium on Multiple Sclerosis Outcomes Study Group. Neurology 1999 Jan 1;52(1):63-70. [Medline]
- Learmonth YC, Motl RW, Sandroff BM, Pula JH, Cadavid D. Validation of patient determined disease steps (PDDS) scale scores in persons with multiple sclerosis. BMC Neurol 2013 Apr 25;13(1):37 [FREE Full text] [CrossRef] [Medline]
- Ritvo PG, Fischer JS, Miller DM, Andrews H, Paty DW, Larocca NG. National Multiple Sclerosis Society. New York; 1997. Multiple sclerosis quality of life inventory: A user's manual URL: http://walkcoc.nationalmssociety.org/docs/HOM/MSQLI_Manual_and_Forms.pdf [accessed 2014-01-20] [WebCite Cache]
- Sangha O, Stucki G, Liang MH, Fossel AH, Katz JN. The Self-Administered Comorbidity Questionnaire: a new method to assess comorbidity for clinical and health services research. Arthritis Rheum 2003 Apr 15;49(2):156-163 [FREE Full text] [CrossRef] [Medline]
- Horton M, Rudick RA, Hara-Cleaver C, Marrie RA. Validation of a self-report comorbidity questionnaire for multiple sclerosis. Neuroepidemiology 2010 Aug;35(2):83-90 [FREE Full text] [CrossRef] [Medline]
- Marrie R, Horwitz R, Cutter G, Tyry T, Campagnolo D, Vollmer T. Comorbidity, socioeconomic status and multiple sclerosis. Mult Scler 2008 Sep;14(8):1091-1098. [CrossRef] [Medline]
- Marrie RA, Horwitz R, Cutter G, Tyry T, Campagnolo D, Vollmer T. The burden of mental comorbidity in multiple sclerosis: frequent, underdiagnosed, and undertreated. Mult Scler 2009 Mar;15(3):385-392. [CrossRef] [Medline]
- Arday DR, Tomar SL, Nelson DE, Merritt RK, Schooley MW, Mowery P. State smoking prevalence estimates: a comparison of the Behavioral Risk Factor Surveillance System and current population surveys. Am J Public Health 1997 Oct;87(10):1665-1669. [Medline]
- Dawson DA, Grant BF, Stinson FS, Zhou Y. Effectiveness of the derived Alcohol Use Disorders Identification Test (AUDIT-C) in screening for alcohol use disorders and risk drinking in the US general population. Alcohol Clin Exp Res 2005 May;29(5):844-854. [Medline]
- Kuczmarski RJ, Flegal KM. Criteria for definition of overweight in transition: background and recommendations for the United States. Am J Clin Nutr 2000 Nov;72(5):1074-1081 [FREE Full text] [Medline]
- Jordan JE, Osborne RH, Buchbinder R. Critical appraisal of health literacy indices revealed variable underlying constructs, narrow content and psychometric weaknesses. J Clin Epidemiol 2011 Apr;64(4):366-379. [CrossRef] [Medline]
- Norman CD, Skinner HA. eHEALS: The eHealth Literacy Scale. J Med Internet Res 2006;8(4):e27 [FREE Full text] [CrossRef] [Medline]
- Rawson KA, Gunstad J, Hughes J, Spitznagel MB, Potter V, Waechter D, et al. The METER: a brief, self-administered measure of health literacy. J Gen Intern Med 2010 Jan;25(1):67-71 [FREE Full text] [CrossRef] [Medline]
- Weiss BD, Mays MZ, Martz W, Castro KM, DeWalt DA, Pignone MP, et al. Quick assessment of literacy in primary care: the newest vital sign. Ann Fam Med 2005;3(6):514-522 [FREE Full text] [CrossRef] [Medline]
- Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika 1951;16:297-334 [FREE Full text] [WebCite Cache]
- Marrie RA, Cutter G, Tyry T, Vollmer T, Campagnolo D. Does multiple sclerosis-associated disability differ between races? Neurology 2006 Apr 25;66(8):1235-1240. [CrossRef] [Medline]
- Hosmer DW, Lemeshow S. Applied Logistic Regression. New York: John Wiley & Sons; 1989.
- Omachi TA, Sarkar U, Yelin EH, Blanc PD, Katz PP. Lower health literacy is associated with poorer health status and outcomes in chronic obstructive pulmonary disease. J Gen Intern Med 2013 Jan;28(1):74-81. [CrossRef] [Medline]
- Rowlands GP, Mehay A, Hampshire S, Phillips R, Williams P, Mann A, et al. Characteristics of people with low health literacy on coronary heart disease GP registers in South London: a cross-sectional study. BMJ Open 2013;3(1) [FREE Full text] [CrossRef] [Medline]
- Buchbinder R, Hall S, Youd JM. Functional health literacy of patients with rheumatoid arthritis attending a community-based rheumatology practice. J Rheumatol 2006 May;33(5):879-886. [Medline]
- Marrie RA, Hadjimichael O, Vollmer T. Predictors of alternative medicine use by multiple sclerosis patients. Mult Scler 2003 Oct;9(5):461-466. [Medline]
- Jacobs LD, Wende KE, Brownscheidle CM, Apatoff B, Coyle PK, Goodman A, et al. A profile of multiple sclerosis: the New York State Multiple Sclerosis Consortium. Mult Scler 1999 Oct;5(5):369-376. [Medline]
- Welch VL, VanGeest JB, Caskey R. Time, costs, and clinical utilization of screening for health literacy: a case study using the Newest Vital Sign (NVS) instrument. J Am Board Fam Med 2011;24(3):281-289 [FREE Full text] [CrossRef] [Medline]
- van der Vaart R, van Deursen AJ, Drossaert CH, Taal E, van Dijk JA, van de Laar MA. Does the eHealth Literacy Scale (eHEALS) measure what it intends to measure? Validation of a Dutch version of the eHEALS in two adult populations. J Med Internet Res 2011;13(4):e86 [FREE Full text] [CrossRef] [Medline]
- Marrie RA, Chelune GJ, Miller DM, Cohen JA. Subjective cognitive complaints relate to mild impairment of cognition in multiple sclerosis. Mult Scler 2005 Feb;11(1):69-75. [Medline]
|BMI: body mass index|
|CI: confidence interval|
|eHEALS: eHealth Literacy Scale|
|ER: emergency room visits|
|METER: Medical Term Recognition Test|
|MS: multiple sclerosis|
|NARCOMS: North American Research Committee on Multiple Sclerosis Registry|
|NVS: Newest Vital Sign|
|OR: odds ratio|
|PCA: principal components analysis|
|PDDS: Patient Determined Disease Steps|
|SD: standard deviation|
Edited by G Eysenbach; submitted 29.09.13; peer-reviewed by A Chiovetti, C Osborn; comments to author 30.10.13; revised version received 31.10.13; accepted 02.11.13; published 10.02.14
©Ruth Ann Marrie, Amber Salter, Tuula Tyry, Robert J Fox, Gary R Cutter. Originally published in the Interactive Journal of Medical Research (http://www.i-jmr.org/), 10.02.2014.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Interactive Journal of Medical Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.i-jmr.org/, as well as this copyright and license information must be included.