This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Interactive Journal of Medical Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.i-jmr.org/, as well as this copyright and license information must be included.
Background
Cardiovascular disease (CVD) represents the greatest burden of mortality worldwide, and statins are the most commonly prescribed drug in its management. A wealth of information pertaining to statins and their side effects is on the internet; however, to date, no assessment of the accuracy, credibility, and readability of this information has been undertaken.
Objective
This study aimed to evaluate the quality (accuracy, credibility, and readability) of websites likely to be visited by the general public undertaking a Google search of the side effects and use of statin medications.
Methods
Following a Google web search, we reviewed the top 20 consumer-focused websites with statin information. Website accuracy, credibility, and readability were assessed based on website category (commercial, not-for-profit, and media), website rank, and the presence or absence of the Health on the Net Code of Conduct (HONcode) seal. Accuracy and credibility were assessed following the development of checklists (with 20 and 13 items, respectively). Readability was assessed using the Simple Measure of Gobbledegook scores.
Results
Overall, the accuracy score was low (mean 14.35 out of 20). While side effects were comprehensively covered by 18 websites, there was little information about statin use in primary and secondary prevention. None of the websites met all criteria on the credibility checklist (mean 7.8 out of 13). The median Simple Measure of Gobbledegook score was 9.65 (IQR 8.825-10.85), with none of the websites meeting the recommended reading grade of 6, even the media websites. A website bearing the HONcode seal did not mean that the website was more comprehensive or readable.
Conclusions
The quality of statin-related websites tended to be poor. Although the information contained was accurate, it was not comprehensive and was presented at a reading level that was too difficult for an average reader to fully comprehend. As such, consumers risk being uninformed about this pharmacotherapy.
statinsconsumer health informationreadabilitycredibilityaccuracydigital health, health information seekingcardiovascularmortalitymanagementpharmacotherapyriskmedicationIntroductionBackground
Cardiovascular diseases (CVDs) are the primary cause of death globally, with an estimated 17.9 million people dying of CVDs in 2021. This represents 31% of all global deaths. Of these deaths, 85% are due to heart attack and stroke, whose most common etiology is atherosclerosis [1]—the development of fatty plaque within artery walls. A key pharmacological treatment for atherosclerosis is statin therapy. It has a role in the primary and secondary prevention of vascular events, with a lowering of low-density lipoprotein cholesterol leading by 2 mmol/L, typically giving a 10% absolute benefit (the reduction in the probability of an event’s occurrence within a population receiving treatment) for those diagnosed with vascular disease and a 5% absolute benefit for those with risk factors yet without having experienced a vascular event [2]. This creates issues when we consider that patients may be biochemically abnormal (with hypercholesterolemia) but asymptomatic. Such patients may doubt the use of the prescribed statin therapy as they determine the cost-benefit balance between tangible adverse effects and theoretical benefits. This may prompt the consultation of alternative sources of knowledge to aid decision-making. In this era of shared decision-making, where patients participate in the medical decisions that affect their health [3], it is essential that the information they access is high quality and easily understood.
Use of the Internet for Health Information Seeking
In this milieu, the internet has risen as a key source of health-related information, with 79% of adults seeking web-based health information in America and 79% to 86% in China, the Philippines, Hong Kong, Indonesia, and Vietnam [4,5]. Comparatively, seeking web-based health information is as popular as playing games or downloading music from the web [6]. Notably, the COVID-19 pandemic has presented unprecedented challenges, catapulting society further into a future dependence on telehealth and internet-assisted health care [7,8]. As such, traditional in-clinic and leaflet modes of health information delivery are being supplemented, and in some cases supplanted, by internet searches. With this dramatic change in the terrain upon which patients and their families are attaining information, it is crucial to determine the quality of web-based health information put forth to them.
Health literacy is defined as “the degree to which individuals have the capacity to obtain, process, and understand basic health information and services needed to make appropriate health decisions” [9]. It requires a complex group of skills such as reading, listening, analyzing, and decision-making, as well as the ability to apply the aforementioned skills to health situations [10]. Those with poor health literacy are vulnerable to undertaking unnecessary tests and treatments or, conversely, refusing beneficial tests and treatments. In part, they may be misled into assessing the quality of web-based health information based on its search result ranking, image quality, celebrity endorsement, and website authorship rather than relying on the criteria of established quality guidelines [11,12].
Health literacy–related knowledge and skills are particularly deficient among vulnerable populations, who are also more likely to experience CVD [12,13]. Unfortunately, those with poor health literacy are susceptible to the influence of mass media and emotionally persuasive texts. This may explain the response to the television program “Catalyst” in Australia [14], whose criticism of statins resulted in 11% of patients (in a survey by the Australian National Heart Foundation of 1094 patients) who watched the program ceasing to take their cholesterol-lowering medication and significant and sustained changes in statin usage, with 2.6% fewer statins (equivalent to 14,005 dispensing) each week [15].
Internet Standards
There is considerable heterogeneity in the quality of web-based health information [16]. The quality of information can be examined in 3 domains: accuracy, credibility, and readability [17]. Each is defined as follows: accuracy is the intent to be evidence based and safe by adequately offering a complete, unbiased picture and its relevance [17]; credibility is the attribution of source and authorship and the disclosure of conflicts of interest for the presented information [18]; and readability is the ease of understanding due to the style of writing, describing the reading comprehension level a layperson requires to understand a text [19,20]. Complex wording reduces engagement with, and application of, content [21]. This leaves patients vulnerable to becoming ill-informed and at risk of adverse health outcomes [22]. The quality of web-based health information is, therefore, a pressing issue, which the Health on the Net Foundation aims to address by providing a Health on the Net Code of Conduct (HONcode) seal, an internet-based certification of medical and health websites that adheres to a set of publishing principles regarding the source and purpose of medical information. However, few consumers are aware of Health on the Net or the HONcode.
While there have been assessments of the quality of websites on many key areas of health care, such as diabetes [23], obesity [24], and hypertension [25], and on surgical interventions [26,27], there is a dearth of assessment about the quality of web-based information pertaining to medications. Such assessments are necessary to inform clinicians of the quality of content likely to be accessed by their patients, who are particularly interested in the likelihood and nature of adverse side effects. We aimed to assess the quality of consumer health information on websites about statins through consideration of accuracy, credibility, and readability.
MethodsStudy DesignOverview
Through this cross-sectional study, we analyzed the accuracy, credibility, and readability of websites that were most commonly presented to patients searching for the keywords “statin” and “statin side effects.” We determined each website’s search engine ranking, category (commercial, not-for-profit, or media), and the presence or absence of the HONcode seal. Furthermore, we determined the relationship between the accuracy, credibility, and readability of the websites found.
In selecting websites on statins to analyze, we aimed to emulate a typical consumer’s search for web-based health information. A web search was conducted using Google, in keeping with evidence that it accounts for more than half of all web traffic [28-30] and is an increasingly preferred search engine by the general public [31]: 91% of American adults using the internet use a search engine, and of those, 83% use Google more often than other search engines [4,32]. To conduct the search, location filters, user information, search history, cached data, and cookies were disabled, and sponsored results were excluded to avoid inadvertent search bias. The search terms used were “statin” and “statin side effects,” following the advice of our lipidologist coauthor (SL) that the generic term “statin,” rather than specific medication names, was commonly used in discussion with patients in clinical practice and that “statin side effects” were a key concern of patients.
The first 20 ranked websites in the Google search results page were analyzed (after removing any duplication from search results of the 2 search terms). We did not identify further websites in the search results, given that, in general, websites returned on the first Google search results page generate 92% of all traffic from an average search [16,33]. This drops by 95% for the second page and by 78% and 58% for subsequent pages [31]. Thus, we did not aim to identify all websites on statins but rather to emulate an authentic consumer search.
Website Search Rank
The effect of the association between search result ranking and accuracy, credibility, and readability was considered. Given that engagement is highest with the first 5 websites in search results, garnering 67% of all clicks from a search results page [31,34], the websites were divided into 4 sets of 5 websites, each according to their ranking as per Google search result. Thus, websites ranked 1-5 were called quartile 1, websites 6-10 were called quartile 2, and so forth.
Website Categorization
In the interest of determining whether the nature of the authorship of the websites had a bearing on their accuracy, credibility, and readability, each of the 20 chosen websites was categorized into 3 types: commercial (defined as a website that generates revenue or cash and is not affiliated with the government), not-for-profit (a website that garners support for a cause rather than revenue, including government and charities), and media (a website that reports new findings or stories, with the primary purpose of the website being news reporting).
Presence of HONcode Seal
We assessed whether the quality of the websites was associated with the presence or absence of the HONcode seal.
MeasuresOverview
In assessing the accuracy, credibility, and readability of the websites, we considered existing tools and developed study-specific tools where necessary.
Accuracy
For accuracy, we developed a statin-specific tool that took into account medical guidelines. The checklist (Table 1) was designed after referring to other studies purporting to assess the quality of web-based health information [17]. A key difference here was that we were looking at a specific treatment. Three features were considered: (1) the intent to be evidence based; (2) safety, in that a website should adequately offer users a complete, unbiased picture of statin treatment; and (3) relevance, in that it is reasonable to expect a website to address the criteria in the checklist [17]. The checklist was intrinsically linked to a website’s comprehensiveness, consistent with other studies that have evaluated completeness as an integral part of accuracy [16].
To meet these features, guidelines from the American College of Cardiology and the Australian Heart Foundation [37] were synthesized into short statements, which formed the accuracy criteria. These statements formed a checklist that each website was required to address to be considered “accurate.” The development of the statements was further informed and determined by a review of the treatment of cholesterol in light of its evidence base [38], as well as criteria from the treatment section of the validated DISCERN tool [39]. This section (items 9-16 of the DISCERN tool) addresses issues of risk, benefit, and how the website guides decision-making surrounding treatment options [39]. Combining these sources ensured that a higher score would be awarded to websites providing the most evidence-based information. In total, 20 equally weighted criteria were devised, and a score of 20 was arbitrarily defined as a minimum acceptable standard.
Each accuracy item was scored as: “present and complete” (2), “present but incomplete” (1), “absent” (0), or “inaccurate” (*). A maximum score of 40 could be awarded to each website assessed. “Incompleteness” was defined as a nonexact or indirect mention of a topic outlined in a criterion rather than an explicit statement. Two reviewers (DdP and E loh) completed the assessment.
Any hyperlinks that navigated to information within a website were followed and the data were included in the final assessment; links leading to external websites were not followed. Embedded videos were analyzed. Once each reviewer concluded their analysis, the results were compared. Discrepancies were resolved through discussion until reaching a consensus.
Website accuracy checklist.
Accuracy criteria
Descriptor
1
Mentions that cholesterol is a modifiable risk factor for cardiovascular disease [35]
2
Mentions that consultation with a doctor is essential before and while taking statins and when ceasing them [36]
3
Lists conditions for which statins are used [36]
4
Defines the target population for statin therapy [37]
5
Mentions the importance of adherence to statin therapy [36]
6
Addresses the subtleties of primary prevention [38]
7
Mentions that statins are about reducing complications of high cholesterol rather than achieving a specific (low-density lipoprotein) cholesterol [38]
8
Describes or at least lists the benefits of statin therapy [39]
9
Describes or at least lists the side effects or risks of statin therapy [39]
10
Describes how treatment affects the overall quality of life [39]
11
Mentions low to moderate dose statin therapy is recommended in primary prevention [37]
12
Specifically addresses rhabdomyolysis [36]
13
Describes the approximate financial burden to the patient [36]
14
Describes the duration of treatment before an effect is measurable [39]
15
Describes how statins work or at least what they do [39]
16
Describes what may happen without treatment [39]
17
Explores the possibility of using alternative therapies to statins [39]
18
Mentions that statins must not be used during pregnancy [37]
19
Describes drug interactions or at least lists them [39]
20
Mentions that statins do not replace a healthy lifestyle [36]
Credibility
In developing the criteria to be included in the assessment of credibility (Table 2), DISCERN was chosen as a reference, as well as other studies that used DISCERN or another available tool for website assessment. However, as the 5-point Likert scale used in DISCERN can be subject to response style bias [40], a present (1) or absent (0) scale was adopted as it has been shown to improve the objectivity of data collection [41-43].
Website credibility checklist.
Item
Criteria
Score criteria
1
Referencing or citations obtained from peer-reviewed journals
1 point if the articles for which the references are obtained are published in peer-reviewed journals [16,44]
2
Website updated within last 24 months
The latest update should be within the past 24 months [45]
3
Avoids anecdotal evidence for making claims
Does not use anecdotal evidence as a basis for claims; quoting a case study without using claims is acceptable [46]
4
Mailing address present
Physical contact address of the website clearly stated [45]
5
Contact information available
Contact information including name, position, telephone number, address, and email [47]
6
Sponsorship stated
Any sponsorship should be clearly stated
7
Organizational privacy policy stated
Organization privacy policy should be clearly stated [47]
8
Declaration of the author’s qualification
Author’s qualification should be health care related [16,44]
9
Paid access tab present
If paid access is available, the difference in the information obtained from paid vs unpaid access should be clearly stated [48]
10
Disclosure of funding or conflicts of interest
Conflicts of interest and funding disclosure should be clearly stated [44]
11
The presence of an HONcode seal or third-party certification
Presence of a HONcodea seal or any other third-party certification [16]
12
Advertisement neutral
Advertisements should steer clear from the website information (eg, no pop-ups related to the website content) [16]
13
Disclaimer regarding web-based health information
A disclaimer should be clearly stated that web-based health information does not replace a practitioner’s advice [44]
aHONcode: Health on the Net Code of Conduct.
Each website was appraised according to this list. A score was allocated for each website’s front page, with internal links explored only if relevant. Data (credibility scores) were undertaken as independent assessments by 2 assessors (E Loh and DdP). The results were compared, and if discrepancies arose, discussions were held to clarify the score, with external input from advisors (HM, SL, and KS) obtained where appropriate.
Readability
For readability, various tools are available, including the Flesch Kincaid Reading Ease, Flesch Kincaid Grade Level, Simple Measure of Gobbledygook (SMOG), and Average Grade Level. We used SMOG as it is considered the gold standard for assessing the readability of health care material and has a high correlation with the other scoring systems [24,49]. Importantly, the outcome measure is easy to understand as, for example, an SMOG readability grade of 6 represents a text comprehensible to all individuals with sixth-grade reading skills and above [50-53]. This grade level was set as the basis of readability, given that the available literature sets this as the standard for “superior” readability. To use this tool, texts from the 20 selected websites were copied and saved as separate Microsoft Word (Microsoft Corp) and plain text documents for analysis, deleting text unrelated to the health information topic (eg, author information or disclaimers) to prevent this from confounding the scoring. A single web-based readability calculator [54] was used to generate the scores.
Data Analysis
The website category and ranking findings were compared by ANOVA, and differences between websites with and without the HONcode seal were analyzed with 2-tailed t tests. In addition, the relationship between credibility and readability with accuracy was assessed by Pearson correlation.
Ethical Considerations
As the research was not conducted on human subjects, no ethics review was required.
ResultsSelected Websites
The top 20 websites returned by the search are listed in Multimedia Appendix 1 [55-74]. Of the 20 websites chosen from the search, 45% (n=9) were categorized as commercial, 45% (n=9) not-for-profit, and 10% (n=2) media (Table 3). There was an even distribution of commercial and not-for-profit websites across the 4 quartiles, with both media websites found in the fourth quartile. Eight of the websites bore the HONcode seal.
Top 20 statin websites’ category, HONcodea presence or absence, accuracy, credibility, and readability.
Website rank
Category
HONcode Seal
Accuracy
Credibility
Readability (SMOGb score)
1
Commercial
Yes
20
6
10.7
2
Not-for-profit
Yes
9
11
11.3
3
Not-for-profit
No
23
9
12.5
4
Commercial
Yes
16
6
13
5
Commercial
No
10
4
7.7
6
Not-for-profit
No
15
7
13
7
Commercial
No
14
10
9.6
8
Not-for-profit
No
13
5
10.8
9
Not-for-profit
No
16
11
10.2
10
Commercial
Yes
11
10
8.6
11
Commercial
Yes
16
9
9.4
12
Commercial
No
13
6
11
13
Not-for-profit
No
17
9
8.9
14
Not-for-profit
No
8
7
9
15
Not-for-profit
No
8
7
10.3
16
Media
No
8
4
7.8
17
Not-for-profit
Yes
16
11
6.7
18
Commercial
Yes
19
8
9.7
19
Commercial
Yes
21
7
9.2
20
Media
No
14
2
8.1
aHONcode: Health on the Net Code of Conduct.
bSMOG: Simple Measure of Gobbledegook.
Accuracy
The mean website accuracy score was 14.35 (SD 4.43). In terms of accuracy, the 3 highest-scoring websites were Wikipedia (score of 23), Drugs.com (score of 21), and Medicine.net (score of 20). These were the only websites to achieve a score of 20 or above. No website contradicted any checklist criterion. The top 3 performing checklist criteria were related to side effects and statin mechanism of action (criteria 9, 12, and 15), with a score of “present and complete” for each of these criteria achieved by 18, 14, and 12 websites, respectively. Although side effects were covered to some degree in all websites, criteria about drug safety (criteria 18 and 19) were complete in only 8 and 7 websites, respectively. Other poorly performing criteria reflected the lack of detail about primary prevention (criteria 11 and 6), with a score of “absent” assigned to 19 and 17 of the websites, respectively.
Credibility
None of the sampled websites met all credibility criteria for a perfect score of 13. The mean score overall was 7.45, with a range of 2-11. Importantly, 12 websites referenced peer-reviewed journal articles as a source of information, and 15 avoided anecdotal evidence for making claims. Media and some commercial websites reported personal opinions. While only 6 websites provided an organization’s contact details, the others provided an email address or feedback form for contact purposes. Sponsorship was explicitly stated in 12 websites, with reference to either government or private organizations. All websites declared their organization’s privacy policy, including websites with lower overall credibility scores. Only 8 websites declared author qualifications, which were primarily health related. None of the websites required paid access. Funding sources were fully disclosed in 11 websites, with the remaining 9 not reporting their source of funding or conflicts of interest. Twelve websites either had no advertisements or non–health care advertisements; the 8 websites that did not meet this criterion were commercial or media websites. Only 5 websites did not include a disclaimer that web-based health information does not replace a practitioner’s advice: all of these websites were commercial or media websites.
Readability
Overall, for SMOG readability, the median was 9.65 (IQR 8.825-10.85) and the average was 9.875 (SD 1.75), that is, above the ninth-grade level. None of the websites met the recommended grade level of 6; even the media websites required an eighth-grade level of comprehension.
Correlation Between Accuracy, Credibility, and Readability
No significant correlation was evident between the correlation between credibilty and accuracy (P=.23) (Figure 1).
Relationship between website credibility (black triangles) and correlation readability (blue squares) with accuracy (P=.23).
Website Search Rank
Websites that featured prominently in search results were not necessarily the most accurate, with no significant difference between the quartiles (P=.64). Indeed, of the 20 websites reviewed, the second highest scoring website for accuracy was ranked in the 19th position on search results. Similarly, there was no difference in credibility (P=.63) or readability (P=.06) between the quartiles.
Website Categorization
Comparing commercial with not-for-profit websites, 2-tailed t tests revealed there was no significant difference in terms of accuracy (P=.275), credibility (P=.83), or readability (P=.452). As there were only 2 media websites, a comparison with them was not made. Notably, they had the lowest scores for credibility, but both scored among the most readable.
Presence of HONcode Seal
Of the 20 websites, 8 were HONcode certified, with 6 of these categorized as commercial websites and 2 as not-for-profit. The mean accuracy scores for websites with and without the HONcode seal were 16 (SD 4.2) and 13.25 (SD 4.4), respectively, but this was not significantly different (P=.18). The presence or absence of the HONcode seal did not preclude a website from scoring at either end of the accuracy scale. Although the 8 websites with the HONcode seal scored higher in credibility (mean 8.5, SD 2) than websites that were not HONcode certified (mean 6.75, SD 2.7), this was not significantly different (P=.139). There was no significant difference in readability scores (P=.92) when comparing websites with HONcode seal status or lack thereof (mean 9.83, SD 1.9 and mean 9.91, SD 1.7, respectively).
Discussion
This study found that overall, the quality of websites with statin-related information tended to be poor. The website content was not sufficiently comprehensive, and the reading level was too difficult for the average reader to fully comprehend. The credibility of the websites varied, although overall websites bearing the HONcode seal had higher credibility than those without.
Here, we formally assessed the quality of websites addressing statins and their side effects. The finding that the quality of information is of variable caliber is consistent with studies investigating web-based health information on other topics [4,17,75]. Although the criteria used by Google’s ranking algorithm is confidential, Google’s guidelines state that it uses a series of algorithms that account for the words of the query, relevance and usability of web pages, the expertise of sources, ease of use on mobile device interfaces, as well as location and settings to determine the results displayed [76,77]. However, this study demonstrates that the most prominent websites in the Google search ranking are not necessarily of high quality.
The lack of correlation between accuracy and credibility or readability is a concern if patients are using the information to understand their condition and take action related to it. Patients with poor health literacy may use inaccurate and untrustworthy information in deciding whether to see a health professional following the onset of symptoms or whether to undertake tests and treatments that may be unnecessary or recommended by health professionals [12]. Vulnerable populations are at higher risk of having poor health literacy and experiencing CVD [12,13], making them especially vulnerable to inaccurate, untrustworthy, and unreadable websites on statins.
While most websites analyzed as part of this study scored low in accuracy, this tended to be attributed to a lack of completeness of information rather than a lack of factual information. While the checklist developed here may be stringent, it would be reasonable to expect that websites dedicated to statins would be comprehensive. The lack of comprehensiveness in the information provided on the websites could result in consumers overlooking important details unless they browse through multiple websites. Furthermore, visits to multiple websites may not generate clarity but confusion. This is due to the increased likelihood of encountering inconsistent information, particularly as websites have different agendas based on the website type. That said, the commercial websites scored, on average, just as well as the not-for-profit websites, indicating that they can be a valuable source of information for consumers. It also indicates that government and other not-for-profit websites will be required to at least match the accuracy of commercial websites if they are to remain relevant in Google’s search algorithm, as having information-rich content is a factor that contributes to higher search rankings [78].
When browsing the internet, one would expect government and other not-for-profit websites to provide credible information. However, some of these websites returned relatively low credibility scores and overall were not significantly more credible than commercial websites. Over half of the 20 websites analyzed provided evidence-based information and avoided anecdotal evidence, increasing their credibility rating [16,44]; however, it was concerning that 5 websites provided information based on anecdotal evidence. As expected, media websites received low credibility scores as news articles about statins contained personal views and anecdotes. Other indicators of credibility were lacking by a large proportion of websites, in particular author qualifications and details about sponsorship, funding, and conflicts of interest [16,44]. Furthermore, many of the commercial and media websites included advertisements, including health-related advertisements [16], and 5 of them did not include the disclaimer that web-based health information does not replace a practitioner’s advice [44]. Thus, even patients with a degree of health literacy would find it difficult to accurately appraise the credibility of many of these websites on statins.
Given that the general public is unlikely to be fully equipped to gauge the credibility of web-based health information presented [12], clinicians could advise that patients identify the presence of the HONcode seal as this merits some confidence in the information presented [16]. However, the code does not necessarily imply that websites are comprehensive. Additionally, website developer application for the HONcode seal is voluntary, so high-quality websites may not bear the HONcode seal. The finding that the readability of the websites with the HONcode seal was not at a suitable level means that such websites may not represent digestible patient health information. Furthermore, a practical issue is that the HONcode seal is at the bottom of the web page and is thus not necessarily evident at first glance.
Many patient demographic groups have been found to read at a level more than 3 years below their completed educational years [79]. Thus, the study results may not be indicative of the severity of the problem posed by websites with high readability scores in terms of the general public’s understanding of web-based information [79]. Those with limited literacy skills tend to have poorer health status due to a lack of knowledge and understanding of health care issues and a diminished ability to participate in shared decision-making in the clinical context [80]. They also tend to have poorer compliance with treatment recommendations and subsequent disease progression, as well as a higher risk for seeking emergency care and more frequent and longer inpatient admissions [27].
Additionally, other factors besides readability play into the way a text is received, including logical and sequential presentation of information. Additionally, alternative media such as images and graphs provide a well-documented “picture superiority” effect that boosts understanding of and engagement with a text [81], although some of these may also require interpretation by consumers.
A limitation of this study of these websites is that the internet is dynamic, with websites updated at any time. The search used in undertaking the study is constrained temporally in its noniterative nature, as well as its method, which used only the major search engine Google. While a metasearch capturing results from multiple search engines would provide a more comprehensive view of the information about statins on the internet, it is unlikely to represent the behavior of the public [82]. Additionally, only 8 of the websites in the study were updated in some way after completion of this study, and the information on some websites is dated as more than 10 years old.
Overall, this study has demonstrated that within the surfeit of information available on the internet regarding statin therapy, the quality of websites is of mixed caliber. The content of information is generally accurate but incomplete, while credibility is variable. Readability is generally of a level too difficult for the general public to comprehend. This suggests a need for guidance to website developers of health care websites in order to capitalize on the vast potential of the internet to equip patients with the empowerment of improved health information and health literacy. It also highlights that clinicians will need to be educated themselves about what is on the internet and what constitutes accuracy, credibility, and readability in order to impart this knowledge to their patients. During the COVID-19 pandemic, the methods through which patients seek information about their health have shifted toward increasingly internet-based means, making the quality of information on the internet of particular significance in the current climate and for the foreseeable future.
Top 20 websites analyzed in the study.
AbbreviationsCVD
cardiovascular disease
HONcode
Health on the Net Code of Conduct
SMOG
Simple Measure of Gobbledygook
The findings were originally developed for the award of a Doctor of Medicine. Publication charges were funded by New South Wales (NSW) Health Pathology.
E Ling attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted. The project was planned by HM with input from all authors. Checklists were developed by E Loh and DdP with the assistance of SL and KS. Data were collected by E Ling, E Loh, and DdP. Data analysis was done by E Ling, E Loh, and DdP with assistance from HM. Data interpretation and manuscript review were done by all authors.
None declared.
Cardiovascular diseases (CVDs)World Health Organization20212023-12-29https://www.who.int/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds)CollinsRReithCEmbersonJArmitageJBaigentCBlackwellLBlumenthalRDaneshJSmithGDDeMetsDEvansSLawMMacMahonSMartinSNealBPoulterNPreissDRidkerPRobertsIRodgersASandercockPSchulzKSeverPSimesJSmeethLWaldNYusufSPetoRInterpretation of the evidence for the efficacy and safety of statin therapyLancet2016388100592532256110.1016/S0140-6736(16)31357-527616593S0140-6736(16)31357-5GradRLégaréFBellNRDickinsonJASinghHMooreAEKasperaviciusDKretschmerKLShared decision making in preventive health care: what it is; what it is notCan Fam Physician20176396826842890403163/9/682PMC5597010MozafarpourSNorrisBBorinJEisnerBHAssessment of readability, quality and popularity of online information on ureteral stentsWorld J Urol201836698599210.1007/s00345-018-2179-92943563910.1007/s00345-018-2179-9KrotKOnline information seeking and trust in doctors: an empirical study201724th International Scientific Conference on Economic and Social Development – "Managerial Issues in Modern Business"October 13-14, 2017WarsawKimHParkSYBozemanIOnline health information search and evaluation: observations and semi-structured interviews with college students and maternal health expertsHealth Info Libr J201128318819910.1111/j.1471-1842.2011.00948.x21831218WosikJClowseMEBOvertonRAdagarlaBEconomou-ZavlanosNCavalierJHenaoRPicciniJPThomasLPencinaMJPagidipatiNJImpact of the COVID-19 pandemic on patterns of outpatient cardiovascular careAm Heart J20212311510.1016/j.ahj.2020.10.07433137309S0002-8703(20)30360-4PMC7604084AndersonJRainieLVogelsEAExperts say the ‘new normal’ in 2025 will be far more tech-driven, presenting more big challengesPew Research Center20212023-12-29Elon Universityhttps://www.pewresearch.org/internet/wp-content/uploads/sites/9/2021/02/PI_2021.02.18_New-Normal-2025_FINAL.pdfInstitute of MedicineBoard on Neuroscience and Behavioral HealthCommittee on Health LiteracyNielsen-BohlmanLPanzerAMKindigDAHealth Literacy: A Prescription to End Confusion2004Washington (DC)National Academies PressPeersonASaundersMHealth literacy revisited: what do we mean and why does it matter?Health Promot Int200924328529610.1093/heapro/dap01419372101dap014MackertMKahlorLTylerDGustafsonJDesigning e-health interventions for low-health-literate culturally diverse parents: addressing the obesity epidemicTelemed J E Health200915767267710.1089/tmj.2009.001219694596PMC2956510KeselmanASmithCAMurckoACKaufmanDREvaluating the quality of health information in a changing digital ecosystemJ Med Internet Res2019212e1112910.2196/1112930735144v21i2e11129PMC6384537HavranekEPMujahidMSBarrDABlairIVCohenMSCruz-FloresSDavey-SmithGDennison-HimmelfarbCRLauerMSLockwoodDWRosalMYancyCWSocial determinants of risk and outcomes for cardiovascular disease: a scientific statement from the American Heart AssociationCirculation2015132987389810.1161/CIR.000000000000022826240271CIR.0000000000000228DemasiMArnottIHeart of the Matter2013AustraliaAustralian Broadcasting CorporationSchafferALBuckleyNADobbinsTABanksEPearsonSAThe crux of the matter: did the ABC's catalyst program change statin use in Australia?Med J Aust20152021159159510.5694/mja15.001032606869310.5694/mja15.00103EysenbachGPowellJKussOSaEREmpirical studies assessing the quality of health information for consumers on the world wide web: a systematic reviewJAMA2002287202691270010.1001/jama.287.20.269112020305jrv10005AhmedOHSullivanSJSchneidersAGMcCroryPRConcussion information online: evaluation of information quality, content and readability of concussion-related websitesBr J Sports Med201246967568310.1136/bjsm.2010.08162021504964bjsm.2010.081620SbaffiLRowleyJTrust and credibility in web-based health information: a review and agenda for future researchJ Med Internet Res2017196e21810.2196/jmir.757928630033v19i6e218PMC5495972KlareGRThe measurement of readability: useful information for communicatorsACM J Comput Doc200024310712110.1145/344599.344630AlamoudiUHongPReadability and quality assessment of websites related to microtia and aural atresiaInt J Pediatr Otorhinolaryngol201579215115610.1016/j.ijporl.2014.11.02725554575S0165-5876(14)00642-9Australia's Health 2018: In Brief2018CanberraAustralian Institute of Health and WelfareMcInnesNHaglundBJAReadability of online health information: implications for health literacyInform Health Soc Care201136417318910.3109/17538157.2010.54252921332302LipariMBerlieHSalehYHangPMoserLUnderstandability, actionability, and readability of online patient education materials about diabetes mellitusAm J Health Syst Pharm201976318218610.1093/ajhp/zxy021314080875290440El-HaddadNSpoonerCFaruqiNDenney-WilsonEHarrisMReadability and content analysis of lifestyle education resources for weight management in Australian general practiceBMC Obes201631610.1186/s40608-016-0097-12696654697PMC4784342GulatiRNawazMLamLPyrsopoulosNTComparative readability analysis of online patient education resources on inflammatory bowel diseasesCan J Gastroenterol Hepatol20172017368198910.1155/2017/368198928740843PMC5504936GrewalPWilliamsBAlagaratnamSNeffendorfJSoobrahRQuality of vascular surgery web sites on the internetJ Vasc Surg20125651461146710.1016/j.jvs.2012.04.05822801107S0741-5214(12)01045-2BadarudeenSSabharwalSAssessing readability of patient education materials: current role in orthopaedicsClin Orthop Relat Res2010468102572258010.1007/s11999-010-1380-y20496023PMC3049622Browser market share AustraliaStatcounter20212021-09-04https://gs.statcounter.com/browser-market-share/all/australiaMartinJBest web browsersTech Advisor20212021-09-04https://www.techadvisor.com/article/728377/best-web-browsers-2021.htmlBakerJBrafton 2017 content marketing benchmark reportBrafton20172021-09-04https://www.brafton.com/blog/strategy/brafton-2017-content-marketing-benchmark-report/Chitika insights: the value of Google result positioningChitika20132023-12-29https://research.chitika.com/wp-content/uploads/2022/02/chitikainsights-valueofgoogleresultspositioning.pdfPurcellKBrennerJRainieLSearch engine use 2012Pew Research Centre20122023-12-29https://www.ris.org/uploadi/editor/1341041853PIP_Search_Engine_Use_2012.pdfMorahan-MartinJMHow internet users find, evaluate, and use online health information: a cross-cultural reviewCyberpsychol Behav20047549751010.1089/cpb.2004.7.49715667044Google organic CTR historyAdvanced Web Ranking20222023-12-29https://www.advancedwebranking.com/ctrstudy/WilsonPWFOverview of established risk factors for cardiovascular diseaseUpToDate20212021-09-04https://www.uptodate.com/contents/overview-of-established-risk-factors-for-cardiovascular-disease#topicContentDavidsonPChewDReducing Risk in Heart Disease: An Expert Guide to Clinical Practice for Secondary Prevention of Coronary Heart Disease2012AustraliaNational Heart Foundation of Australia18StoneNJRobinsonJGLichtensteinAHMerzCNBBlumCBEckelRHGoldbergACGordonDLevyDLloyd-JonesDMMcBridePSchwartzJSSheroSTSmithSCWatsonKWilsonPWF2013 ACC/AHA guideline on the treatment of blood cholesterol to reduce atherosclerotic cardiovascular risk in adults: a report of the American College of Cardiology/American Heart Association task force on practice guidelinesJ Am Coll Cardiol20146325 Pt B2889293410.1016/j.jacc.2013.11.00224239923S0735-1097(13)06028-2KrumholzHMTreatment of cholesterol in 2017JAMA2017318541741810.1001/jama.2017.6753287381302645740CharnockDShepperdSDiscern Online20212021-09-03United KingdomRadcliffe Onlinehttp://www.discern.org.uk/background_to_discern.phpBeaunoyerEArsenaultMLomanowskaAMGuittonMJUnderstanding online health information: evaluation, tools, and strategiesPatient Educ Couns2017100218318910.1016/j.pec.2016.08.02827595436S0738-3991(16)30402-5PeabodyDTwo components in bipolar scales: direction and extremenessPsychol Rev196269657310.1037/h003973714484721KomoritaSSGrahamWKNumber of scale points and the reliability of scalesEduc Psychol Meas201625498799510.1177/001316446502500404DolnicarSGrünBLeischFRossiterJThree good reasons NOT to use five and seven point Likert items201121st CAUTHE National ConferenceFebruary 8-11, 2011Adelaide, AustraliaWeymannNHärterMDirmaierJQuality of online information on type 2 diabetes: a cross-sectional studyHealth Promot Int201530482183110.1093/heapro/dau01924688114dau019FreemanKSSpyridakisJHAn examination of factors that affect the credibility of online health informationTech Commun2004512239263SillenceEBriggsPHarrisPFishwickLA framework for understanding trust factors in web-based health adviceInt J Hum Comput Stud200664869771310.1016/j.ijhcs.2006.02.007NeumarkYFlumLLopez-QuinteroCShtarkshallRQuality of online health information about oral contraceptives from Hebrew-language websitesIsr J Health Policy Res2012113810.1186/2045-4015-1-38230067982045-4015-1-38PMC3475130MetzgerMJMaking sense of credibility on the web: models for evaluating online information and recommendations for future researchJ Am Soc Inf Sci Technol200758132078209110.1002/asi.20672FitzsimmonsPRMichaelBDHulleyJLScottGOA readability assessment of online Parkinson's disease informationJ R Coll Physicians Edinb201040429229610.4997/JRCPE.2010.40121132132McLaughlinGHSMOG grading-a new readability formulaJ Read1969128639646WangLWMillerMJSchmittMRWenFKAssessing readability formula differences with written health information materials: application, results, and recommendationsRes Social Adm Pharm20139550351610.1016/j.sapharm.2012.05.00922835706S1551-7411(12)00077-0OliffeMThompsonEJohnstonJFreemanDBaggaHWongPKKAssessing the readability and patient comprehension of rheumatology medicine information sheets: a cross-sectional health literacy studyBMJ Open201992e02458210.1136/bmjopen-2018-02458230813117bmjopen-2018-024582PMC6377552ChengCDunnMHealth literacy and the internet: a study on the readability of Australian online health informationAust N Z J Public Health201539430931410.1111/1753-6405.1234125716142My Byline mediaReadability Formulas2021-09-04https://readabilityformulas.com/MedicineNet2024-02-07https://www.medicinenet.com/statins/drug-class.htm#what_are_statins_and_how_do_they_workStatinsHealthdirect2024-02-07https://www.healthdirect.gov.au/statinsStatinWikipedia2024-02-07https://en.wikipedia.org/wiki/StatinBruceDFStatin side effectsWebMD2024-02-07https://www.webmd.com/cholesterol-management/side-effects-of-statin-drugs#1MannDPallaritoKAre statins bad for you? 4 things to knowHealth2024-02-07https://www.health.com/health/gallery/0,,20552165,00.htmlStatinsMedlinePlus2024-02-07https://medlineplus.gov/statins.htmlStatinsHealthEngine2024-02-07https://healthengine.com.au/info/statinsStatinsNHS2024-02-07https://www.nhs.uk/conditions/statins/Statin side effects: weigh the benefits and risksMayo Clinic2024-02-07https://www.mayoclinic.org/diseases-conditions/high-blood-cholesterol/in-depth/statin-side-effects/art-20046013Side effects of atorvastatinHealthline2024-02-07https://www.healthline.com/health/high-cholesterol/statins-list-of-common-typesThe uses and risks of statinsMedical News Today2024-02-07https://www.medicalnewstoday.com/articles/8274.phpMercolaJYou've been genetically hijacked to produce Pfizer's Pfrankenstein proteinsMercola20242024-02-07https://articles.mercola.com/sites/articles/archive/2010/07/20/the-truth-about-statin-drugs-revealed.aspxAtorvastatinNHS2024-02-07https://www.nhs.uk/medicines/atorvastatin/Statin adverse effectsStatin Effects Study2024-02-07https://statineffects.com/info/adverse_effects.htmGetting treatment: the most widely used medicine to lower cholesterol is a statin, but there are other medicines available too and some may only be prescribed in a specialist lipid clinicHeart UK2024-02-07https://www.heartuk.org.uk/getting-treatment/treatment-introGajrajHWhy I've ditched statins for goodThe Telegraph20142024-02-07https://www.telegraph.co.uk/news/health/10717431/Why-Ive-ditched-statins-for-good.htmlStatin medicines: frequently asked questionsNPS MedicineWise2024-02-07https://www.nps.org.au/consumers/statin-medicines-frequently-asked-questionsZocorRxList2024-02-07https://www.rxlist.com/zocor-side-effects-drug-center.htmSimvastatinDrugs.com20232024-02-07https://www.drugs.com/simvastatin.htmlNedelmanMStatins: what happens to patients who stop taking them after side effects?CNN Health20172024-02-07https://edition.cnn.com/2017/07/24/health/statins-side-effects-outcomes-study/index.htmlBernardSCookeTColeTHachaniLBernardJQuality and readability of online information about type 2 diabetes and nutritionJAAPA20183111414410.1097/01.JAA.0000546481.02560.4e3035867901720610-201811000-00007How search algorithms work mountain viewGoogle2023-12-29https://www.google.com/search/howsearchworks/algorithms/MakinoTJungCPhanDFinding more mobile-friendly search resultsGoogle Search Central Blog20152023-12-29https://developers.google.com/search/blog/2015/02/finding-more-mobile-friendly-search]Webmaster guidelines mountain viewGoogle20212023-12-29https://developers.google.com/search/docs/essentialsWeissBDProgress in health literacy-encouraging, and not so encouragingHealth Lit Res Pract201714e231e23210.3928/24748307-20171016-0131294267PMC6607785WeissBDSchwartzbergJGHealth Literacy and Patient Safety: Help Patients Understand: Manual for Clinicians, Volume 12007TucsonAmerican Medical AssociationKasabwalaKAgarwalNHansberryDRBaredesSEloyJAReadability assessment of patient education materials from the American Academy of Otolaryngology—Head and Neck Surgery FoundationOtolaryngol Head Neck Surg2012147346647110.1177/0194599812442783224738330194599812442783BreakeyVRHarrisLDavisOAgarwalAOuelletteCAkinnawoEStinsonJThe quality of information about sickle cell disease on the internet for youthPediatr Blood Cancer2017644e2630910.1002/pbc.2630927786409