Published on 12.08.13 in Vol 2, No 2 (2013): Jul-Dec
The Computerized Medical Record as a Tool for Clinical Governance in Australian Primary Care
Background: Computerized medical records (CMR) are used in most Australian general practices. Although CMRs have the capacity to amalgamate and provide data to the clinician about their standard of care, there is little research on the way in which they may be used to support clinical governance: the process of ensuring quality and accountability that incorporates the obligation that patients are treated according to best evidence.
Objective: The objective of this study was to explore the capability, capacity, and acceptability of CMRs to support clinical governance.
Methods: We conducted a realist review of the role of seven CMR systems in implementing clinical governance, developing a four-level maturity model for the CMR. We took Australian primary care as the context, CMR to be the mechanism, and looked at outcomes for individual patients, localities, and for the population in terms of known evidence-based surrogates or true outcome measures.
Results: The lack of standardization of CMRs makes national and international benchmarking challenging. The use of the CMR was largely at level two of our maturity model, indicating a relatively simple system in which most of the process takes place outside of the CMR, and which has little capacity to support benchmarking, practice comparisons, and population-level activities. Although national standards for coding and projects for record access are proposed, they are not operationalized.
Conclusions: The current CMR systems can support clinical governance activities; however, unless the standardization and data quality issues are addressed, it will not be possible for current systems to work at higher levels.
Interact J Med Res 2013;2(2):e26
- clinical governance;
- electronic health records;
- general practice;
- realist evaluation;
- quality assurance;
- health care
Clinical governance is an approach to ensuring quality and accountability that incorporates the obligation that patients are treated according to best evidence ().
Computerized medical records (CMR-see) provide a viable mechanism for implementing clinical governance [ ]. Computers are involved in all aspects of the clinical interaction-from consulting room to system-level use of large systems that might control entitlement to treatment, screening, recall, and on-line booking of services [ , ]. In Australia, the UK and Netherlands, primary care is highly computerized, with almost all primary care physicians using a CMR; while in the US and Canada, primary care is less computerized, with the hospital sector leading the way [ ]. Between 20% and 40% of the clinical consultation is spent interacting with the computer [ - ].
It is important to understand the context within which records are created . Simply having a CMR does not guarantee the creation of a complete record usable for clinical governance purposes; the interaction with the computer in the consultation is complex and evolving [ ]. Using a CMR is not a neutral act [ ]; there are barriers to using the computer and coding systems [ ] and interfacing with them constrains what is recorded [ , ]. However, the CMR does enable the running of decision support programs that can reduce errors, [ ] and it can improve quality though audit/feedback cycles [ ]. There are issues about the governance of these records and the repositories derived from these data; and formal governance structures are often lacking [ ].
We carried out this investigation to see, firstly, how the nature of the design of different vendors’ CMR systems enable and constrain clinical governance and, secondly, how individuals and groups might use computers differently as tools to measure quality and to achieve clinical governance objectives. We describe an assessment tool that would enable others to assess the extent to which any CMR could act as a mechanism within their health care context to support clinical governance.
This study was a component of a larger systematic review and realist synthesis of clinical governance in primary care . The CMR had the allure of being an unrealized tool to support clinical governance, measuring quality, conducting clinical audit, and ensuring safety ( ). We therefore undertook an analysis of CMR systems used in Australia, exploring the extent to which the CMR supported clinical governance, including to what extent this reflects contextual factors that may be unique to the Australian context. In keeping with the main study framework, we performed a structured analysis in conjunction with key themes emerging in the main study from a literature review and informant interviews. We analyzed seven CMR products used in Australia, and also their capacity to deliver clinical governance. We concluded by developing a maturity framework for CMRs in relation to clinical governance, and classified the maturity of the various CMRs.
We carried out a review from a realist perspective, mirroring the approach of the main study , modifying the approach previously used to explore the success and failures of the UK National program for IT [ ]. A realist perspective is useful in assessing complex interventions as it aims to develop explanatory analyses of why and how these interventions may work in particular settings and contexts. The realists mantra is: “Context (C)” plus causal link with an appropriate “Mechanism (M)” results in an “Outcome (O)”; in other words, “C+M=O”. Part of the realist perspective is that effects are reported according to the three Ws: “What Works, for Whom, and in What circumstances.”
In realist evaluations, there can sometimes be difficulty in distinguishing context and mechanism. In this analysis, the context (C) is the Australian primary health care context, and the mechanism (M) is the CMR system used at the point of care. Our outcome measure (O) was the ability to produce clinical governance outputs through the ability to monitor quality of care against given criteria and standards. This combination describes how in the Australian context (C), the CMR, might contribute as a mechanism (M) to deliver the outcome measure (O), clinical governance (C+M=O) ().
We mapped the primary care context using Lusignan’s 4 component classification :
- Organization: We considered the ways in which primary health care was organized at the practice, locality, and at the national level in Australia.
- Individual clinicians: We considered the level of knowledge, skill in operation, and attitude toward CMR among individual general practitioners.
- Clinical task: We considered the clinical context during which the CMR would be used. This was usually a one-to-one clinical consultation, in which the presence of the desk-based CMR created a triadic clinical relationship [ ].
- Technology: We considered the features of the technology, which are unique to the particular context. Australia is in the process of enhancing broadband access, but this is unequally distributed around the country.
The contextual features discovered through this review were then analyzed in concert with the mechanisms of the CMR described below to develop a nuanced understanding of how the CMR operated in this particular environment to produce governance outcomes.
To identify the ways in which the CMR operated in relation to clinical governance, we used the Donabedian  classification of structure and process elements to describe the three types of mechanism by which CMRs may enable the delivery of improved clinical governance: structures, processes of care and review, and processes that impact on outcome. In this study, the software settings were considered to be process elements. For example, a key enabler of clinical governance-such as the presence of a unique patient identifier within the system, essential for data aggregation-would be listed as a key component of the mechanism provided by the CMR.
- “Structures” included the physical structures and design features (including conventions for room layout, record architecture, and linkages).
- “Processes of care and review” included software capabilities such as the issuing of prescriptions.
- “Processes that may impact upon on patient outcomes” included elements such as the ability of the CMR system to detect and block all serious drug interactions.
Each of these categories was subcategorized to produce the detailed tool across the categories (). The CMR structure was divided using the Open EHR model of the four separate components of a CMR system: interface, clinical archetypes, coding system, and database.
We explored factors related to clinical governance outcomes occurring at the level of the patient, the health care provider, and the setting (ie, impact at the population- or health system-level) .
We created a new assessment tool (), a bi-axial tool, where the previously-described taxonomies of mechanism and context occupied each of the axes. The cells of the grid are populated with outcomes related to clinical governance for patients/clients, the provider, and the broader population level.
Assessing the Top Six Brands and One Example of a CMR System With a Low User Base
We developed a CMR maturity model, again using the Donabedian classification into structures (including IT architecture issues), process and outcomes, using existing consensus about CMR maturity [- ]. At the structural level, we looked at the number of vendors and their market share, use of standards and interoperability, and the use of unique patient identifiers and clinical coding (eg, single national coding system). The processes were graded from passive reporting through to active decision support-again looking at individual patient, practice or locality and population levels. Outcomes data were expressed in terms of feedback about quality ( ).
The process and potential of the CMR to influence clinical governance outcomes were graded into a four-level model (). This grading is multi-dimensional: (1) the agency of the CMR: namely, does the CMR play a passive or dependent role compared to an active or autonomous role in delivering clinical governance, (2) the level of complexity of the transaction and whether or not it is adaptive [ ], (3) the degree of integration with other information systems, and (4) the physical integration and linkage processes underpinning it.
In Australia primary care is delivered via general practice through around 7000 discrete practices. Practices in Australia have a variety of ownership structures including corporate owners, partners, associates, and sessional general practitioners (GPs). Some CMRs enabled varying degrees of control according to status within the practice-owner, employee, etc. Patients are free to visit any GP of their choice, and GPs act as gatekeepers to secondary care. Mobility of patients between practices means that they lack the stable population denominator of registration based systems such as those found in the UK or Netherlands. Funding is largely fee-for-service underpinned by a national insurance scheme, but there are many accessory payments  and other programs [ ]. The CMR systems also allowed for different role-based access for nurses and receptionists. Standards for clinical governance have been introduced by the Royal Australian College of General Practitioners [ ].
The Individual Clinician
The GPs in Australia are trained in the Australian General Practice Training Program. The curriculum for training  includes a specific section on eHealth focussed on the practical use of computers, but not their application as a tool for clinical governance. A total of 98% of GPs have a computer on their desk, which they use them for clinical purposes [ ]. Most GPs use their CMR for recall, maintenance of immunization registers, monitoring of population health, making clinical notes, and/or recording diagnoses using a clinical coding system [ ]. There are some 22+ clinical packages in the market. Over 40% of GPs are involved in some sort of audit or quality assurance cycle associated with using their computer data, usually mediated by the local Division of General Practice [ ]. These activities require good data and appropriate extraction techniques.
Although doctors use many sources of information in the consultation , it is the clinical packages that can have the largest impact on the clinical outcomes. In general practice, the government has encouraged good data recording through its Practice Incentive Program. Practices have received payments for recording allergies and the creation of summary data in their CMRs.
We identified four technological issues that compromise clinical governance activities:
- Different (and local) coding systems make national and international comparison of quality more challenging.
- The absence of standards meant CMR vendors can choose to develop and implement their own messaging ‘standard’ for use between variants of their program including use of varying flavors of Health level-7 (HL7), with much less scope for quality control and minimizing the risk of inbuilt errors.
- Patient access to the record was absent. Such facilities are not part of the Australian landscape yet.
- Backup facilities were not inbuilt functions of the software, but were integrated into general system backups according to accepted guidelines.
The individual clinician had little influence on the software processes. In comparison with paper records, we felt the CMR disempowered the clinicians–in effect ceding many areas of control to the organization or the technology. Customization options were minimal. Some programs did not allow individual doctors to change their passwords without going through an administrator. Access controls for all staff were either set by the program or customisable by a designated administrator.
A significant amount of data required to perform key clinical tasks is now provided by third parties, who have to be trusted themselves to have proper governance systems. The responsibility, governance, and overall control of these information sources sit outside of the CMR. For example, drug information was derived from either government sources or from the industry. Until 2009, the most popular general practice software incorporated screen drug advertising. An audit of these advertisements found that 95% were non-compliant with the Medicines Australia Code of Conduct, though there was a little evidence that this impacted upon prescribing practice [, ]. Most programs sourced travel medicine advice from a variety of industry sources. Immunization schedule data was the one area that used a common, validated source (the federal government).
There are significant gaps and variability between Australian CMR systems in their drug interaction checking , though these issues are international [ ]. While there are standards about CMR functionality they largely fail to include how applications should perform in clinical environments [ ] especially as the CMR becomes more ‘active’ in the patient space [ ].
Some areas were easy to ascribe to an actor, but others were quite complex. Drug Interactions, for instance, required taking an externally provided database, integrating it into the program, and then allowing GPs to potentially customize the level of alert setting, and then integrate all of that into the consultation. Others such as practice audit required a reliable software process that was then dependent on a practice system to make best use of the information.
Mechanism: The CMR
All systems generated a unique identifier for each patient, and all recorded the Medicare number (a non-unique number used for the federal insurance scheme). All CMR systems utilized a graphical user interface and all had standard clinical archetypes such as history, examination, past history, and social history. All were able to provide a summary view although differences in those views were apparent . All were able to code diagnosis and problem list data, although four different coding systems were used: International Classification of Primary Care, International Classification of Disease version 10 (ICD-10), Pyefinch, and Doctor Command Language. One system that used the ICD-10 classification incorporated the ICD-10 procedure code; thus, the system included more extensive classification on complications of cataract procedures than it did on hypertension. The system required so much clicking to turn off the classification system that doctors reported bypassing the classification system altogether.
None used the Systematised Nomenclature of Medicine–Clinical Terms, the official Australian standard and none required data to be entered in a coded fashion, and two of the coding systems are specific to that brand of software. All the CMR systems allowed attribution of data according to login or according to source. Some incoming data (such as specialist letters) required manual attribution, while for data such as pathology, the attribution was automatic.
Every CMR system was able to accept pathology and radiology as atomized data (either HL7 or Pathology Interchange Format). All programs allowed linking of requests with received reports. Four packages allowed both generation of electronic documents and receipt. All used proprietary systems to do this, with little ability to work cross platform.
The CMR systems (in keeping with the genesis of software systems as electronic prescribing packages) had comprehensive drug databases. Most used the database from MIMS Australia, otherwise using information from a variety of sources. Data regarding Australia’s Pharmaceutical Benefits Scheme (PBS), which detailed government subsidies for most drugs, was sourced from the PBS itself. All had the ability to generate drug interactions, although users were able to set the level of drug interaction alerts and in several systems turn them off altogether. Use and availability of drug calculators (weight/dose calculators or warfarin calculators) was extremely variable. All packages had a variety of other external information sources available from within the system.
All CMR systems had immunization information; many had travel information, and one had an extensive library of text based health information resources within the program.
All programs have search functions built into the system. Most have some inbuilt searches (patients over 65 years, eligible patients without a cervical smear in the last five years) that relate to funding initiatives or chronic disease management. The ability to do other searches was quite variable and often required significant computer/database knowledge
Mechanism: Processes of Care and Review
Only four of the CMR systems were able to participate in regional data quality activities. These activities revolve around the Australian Primary Care Collaborative program, The Practice Health Atlas and the PEN Clinical Audit tool . All these activities require the use of an external tool to interrogate the program’s database and generate pooled data. One other package had its own tool to perform similar functions. All programs were able to generate pay-for-performance lists, according to the particular funding initiative.
Mechanism: Processes That May Impact on Outcome
No system had inbuilt data quality checks (prescribing insulin without a diagnosis of diabetes for example). One system had its own ‘in-house’ sentinel/research network ability; no other program had such a designated function.
When context () and mechanism ( ) were explored together, we found that the contextual limitations associated with the technology landscape and clinician autonomy over the CMR compounded the limitations identified in the analysis of mechanisms, associated particularly with processes. The result is that these systems have limited demonstrable outcomes in relation to clinical governance.
Demonstrated Outcomes for the Patient or for the Health Care Provider
Most medical records are computerized and widely used for clinical governance activities, but these approaches are fragmented . None of the packages dealt effectively with health outcomes, in the sense that they were able to adequately demonstrate improved care from within their own processes. Assessing health outcomes required an interpretive process by accessing and comparing external data. The tool asked for ‘surrogate markers of quality’ and ‘outcome measures’, neither of which was particularly well or sufficiently defined to be assessed. However, in the future, these features will become of prime importance.
Outcomes at Population Level
None of the CMRs was able to deal directly with these issues. However, the ability of the systems to provide data to inform activities at this level is increasingly crucial for health system management if we want to be able to explore what population interventions might have impact. Medicare locals, the regional support bodies for primary care services, are able to use the data for informing practice at a local level , but the ability for this data source to influence national activities is currently poor.
At the structural level, Australian CMRs are well developed but there is scope for further progress against our maturity framework. Lacking are open standards, as yet no implementation of a standard coding system, and probably too many vendors in a relatively small market.
Australian primary care is therefore largely at level 2, with some systems only supporting level 1 and with some systems offering level 3 models. There was no evidence of level 4 systems. Some CMR systems had features that from the international perspective must be a developmental blind alley. The local coding systems are one of these; it is unlikely to ever become part of an interoperable health system.
In the Australian context, at practice and locality level the CMR works well, and is being used to facilitate clinical governance activities. Nearly all practices have systems with search functionality that enable participation in clinical audit.
However, while practices and localities are widely engaged in clinical governance processes, these are usually being done in an uncritical way. In particular, there is little attention given to data quality, or the obligation to code clinical conditions in standardized extractable fashion.
The record structures are often proprietary and there is a dearth of open architectural models, with many mission critical functions happening within a black box.
Implications of the Findings
Benchmarking standards at a national or international level will be challenging if poor data quality and the disparate nature of record systems and system architecture remain unaddressed. Although not a registration based system, denominators such as those who attended in the last year can be used to make comparisons between practices and systems.
It is not possible to have lossless conversion of data held in one coding system to another, and the use of idiosyncratic coding systems increases the risk of data loss. While statistical techniques, in particular multiple imputation , can be used to compensate for missing data, this is never the same as having complete data. Black box data extraction processes and audit systems tend to foster uncertainty about the validity of findings.
Disease registers are much more challenging to set up when there is incomplete coded data, and patients with a condition not on a disease register are not going to benefit from computerized prompts or recall. Their standard of care may also be lower. This data quality and use issue will become a major problem as more information is shared.
Comparison With the Literature
The complexity of the clinician-patient-computer interaction, touched on in the introduction, is reflected elsewhere in the literature. Patient-centered care [, ] and relationship-centered care [ ] have taken hold and been shown to affect the outcomes. Computerization is changing the balance of power in the interaction [ ].
There is no requirement for CMR systems to provide any specific functionality whatsoever, no set of criteria over information use, and no standards over usability or even formally recommended testing protocols . The ‘Swiss cheese’ model of error [ ] highlights how gaps in complex systems can result in errors, which in turn can raise patient safety issues. Drug interaction checking is an example of this, with interaction resources needing to be integrated into the prescribing package and then used by the clinician. While the UK National Program for IT has been much criticized, the one area that appears to have stood the test of time has been the rigid implementation of a drug dictionary and messaging standards [ ].
Patient access to their records has become the norm elsewhere  and increased openness may help ensure good governance. Australia has aspirations to provide patient access through the National “Personally Controlled Electronic Health Record” program. Online access is no panacea; however, uptake of access to very different models of online summaries of care has been poor uptake in both England and France [ ].
A comparison with the UK system of CMR driven pay-for-performance suggests that there may be quality gaps that computer mediated incentives might help close [, ]. Additionally, the UK Primary Care Information Service (PRIMIS) has promoted data quality through a wide range of initiatives. The PRIMIS approach has been one of facilitation and feedback rather than financial incentives. These have been clinically focussed and included looking at disparities in data quality heart disease and improving patient safety [ , ]. However, more recently, the English NHS has gone through a game changing transformation with extraction of data on a National Scale through a system called the General Practice Extraction Service This gives the potential to extract data to measure quality and clinical governance on a national scale. The GPES system has its own Independent Advisory Group (SdeL is the Royal College of General Practitioners representative) to: “Consider the risks and benefits in order to assess whether the extraction is in their view appropriate and in the public interest.”
Limitations of the Method
The evaluation took place at a point in time in 2009, and each package has gone through several upgrades over that time. As such, this analysis is not meant as a detailed critique of the packages with recommendations. It is quite possible that many of the comments here may no longer apply to a specific package. Moreover, it is the first discussion of the increasing influences on clinical governance by CMRs, with a framework that can be applied serially or in different contexts. What is lacking in planning and development is a consistent approach to thinking about CMRs and clinical governance, and what systemic controls should be there.
We might have explored the extent to which the standardization of record formats might have aided comparison and measurement of quality. The Royal College of Physicians, UK, has been very active in trying to standardize records reporting handovers, including admission and discharge ; it is likely that such a process would facilitate the implementation of clinical governance process. Although we make reference to the Open EHR initiative in our method we have not fully described its potential impact on standardization, and therefore toward being able to contribute to governance by facilitating the measurement and compare clinical standards on different systems. The two elements of Open EHR we believe that contributes most are its clinical models program, which enables researchers and practitioners to build sharable archetypes of clinical concepts [ ]; and the specification program that defines data, services, and application program interfaces and offers the allure of quality certification of systems [ ].
There are also other models we might have used for example: Yousuf et al have proposed an adoption model that includes: user attitude and skills base together with good leadership, IT-friendly environment, and good communication . Lau et al have identified factors that influence adoption, and that it includes people, organization, implementation, and the macro environment [ ].
These models share some similarity in that they both identify socio-technical aspects of implementation. Had we used either of these models, our subheadings might have been different but our findings are unlikely to have changed. Our selection driven by the wish to emphasize the interaction between organization (which included governance), the individual clinician, the clinical task (which should be of quality) and the technology; and not predefined success factors or progressive levels that should be reached.
Call for Further Research
The observations in this study have not been tested in a controlled trial and are retrospective in nature. Although we have approached this study from a neutral position of identifying factors that helped and hindered there may be bias. One author (CMP) is very familiar with many of the brands of Australian CMR and may have been susceptible to familiarity bias , and pointed out issues he was previously aware of. However, SdeL does not share this bias, instead having his experience framed in other countries’ CMR systems. Our assertion is that the CMR is as an instrument of and for clinical governance. At the very least, the CMR provides the tools to enable clinical audit and retrospective analysis of data. At its best the CMR can flag, recall, remind to monitor, and provide information support, and taking an ever more active role in the consultation. The current use of CMRs in Australia supports clinical governance at the individual patient, practice and possibly locality level; but provides no insights at the national level. Where the CMR does not facilitate clinical audit, individual practitioners are blocked from raising quality standards. We need to further test this hypothesis in prospective trials.
We have developed a framework for evaluating how CMR systems support clinical governance in a particular context; and whether the CMR has helped to achieve those goals. By applying the tool to several different brands of Australian CMRs, we have highlighted the issues that exist today, but importantly shown a graded way forward using a simple model and maturity framework that we hope can be readily followed by clinician users of these systems.
The limitations of the process relate to the heterogeneity of the data and their sources, the continuing change over time, but above preeminent is the lack of implementation of standards. While CMR implementation in Australia has enabled better clinical governance improving systems technical capability and rigorous standardization is needed to enable more comprehensive assessment of quality and outcomes for patients.
Our research was funded by a grant from the Australian Government Department of Health and Ageing through the Australian Primary Health Care Research Institute (APHCRI). The opinions expressed in this article are not the opinions of APHCRI or the Department of Health and Ageing.
Conflicts of Interest
Multimedia Appendix 1
Software assessment schema.PDF File (Adobe PDF File), 62KB
- de Lusignan S. Clinical Governance. In: Bevir M, editor. Encyclopedia of Governance - 2 volume set. Thousand Oaks, California: Sage Publications, Inc; 2007:99-101.
- Purves IN. Facing future challenges in general practice: a clinical method with computer support. Fam Pract 1996 Dec;13(6):536-543 [FREE Full text] [Medline]
- Jha AK, Doolan D, Grandt D, Scott T, Bates DW. The use of health information technology in seven nations. Int J Med Inform 2008 Dec;77(12):848-854. [CrossRef] [Medline]
- Bui D, Pearce C, Deveny E, Liaw T. Computer use in general practice consultations. Aust Fam Physician 2005 May;34(5):400 [FREE Full text] [Medline]
- Pearce C, Kumarpeli P, de Lusignan S. Getting seamless care right from the beginning - integrating computers into the human interaction. Stud Health Technol Inform 2010;155:196-202. [Medline]
- Kumarapeli P, de Lusignan S. Using the computer in the clinical consultation; setting the stage, reviewing, recording, and taking actions: multi-channel video study. Using the computer in the clinical consultation; setting the stage, reviewing, recording, and taking actions: multi-channel video study J Am Med Inform Assoc Published Online First: 14 December 2012 2012-00 2012:e67-e75. [CrossRef]
- Campbell SM, Sweeney GM. The role of clinical governance as a strategy for quality improvement in primary care. Br J Gen Pract 2002 Oct;52 Suppl:S12-S17 [FREE Full text] [Medline]
- Pearce C, Trumble S. Computers can't listen--algorithmic logic meets patient centredness. Aust Fam Physician 2006 Jun;35(6):439-442 [FREE Full text] [Medline]
- de Lusignan S, Wells SE, Hague NJ, Thiru K. Managers see the problems associated with coding clinical data as a technical issue whilst clinicians also see cultural barriers. Methods Inf Med 2003;42(4):416-422. [CrossRef] [Medline]
- de Lusignan S. The barriers to clinical coding in general practice: a literature review. Med Inform Internet Med 2005 Jun;30(2):89-97. [CrossRef] [Medline]
- Tai TW, Anandarajah S, Dhoul N, de Lusignan S. Variation in clinical coding lists in UK general practice: a barrier to consistent data entry? Inform Prim Care 2007;15(3):143-150. [Medline]
- Shachak A, Reis S. The impact of electronic medical records on patient-doctor communication during consultation: a narrative literature review. J Eval Clin Pract 2009 Aug;15(4):641-649. [CrossRef] [Medline]
- Borycki E, Kushniruk A. Identifying and preventing technology-induced error using simulations: application of usability engineering techniques. Healthc Q 2005;8 Spec No:99-105 [FREE Full text] [Medline]
- de Lusignan S, van Weel C. The use of routinely collected computer data for research in primary care: opportunities and challenges. Fam Pract 2006 Apr;23(2):253-263 [FREE Full text] [CrossRef] [Medline]
- Reti SR, Feldman HJ, Safran C. Governance for personal health records. J Am Med Inform Assoc 2009 Feb;16(1):14-17 [FREE Full text] [CrossRef] [Medline]
- Phillips CB, Pearce CM, Hall S, Travaglia J, de Lusignan S, Love T, et al. Can clinical governance deliver quality improvement in Australian general practice and primary care? A systematic review of the evidence. Med J Aust 2010 Nov 15;193(10):602-607. [Medline]
- Pawson R, Tilley N. Evidence Based Policy, a Realist Perspective. In: Realistic evaluation. London: Sage; 1997.
- de Lusignan S. Improving Data QualityClinical Records: Lessons from the UK National Program about Structure, ProcessUtility. 2009 Presented at: In: de Lusignan S. editor. 1st International Conference on Information Technology Interfaces; 2009; Dubrovnik.
- Scott D, Purves I. Triadic relationship between doctor, computer and patient. Interacting Comput 1996;8(4):347-363.
- Donabedian A. Evaluating the quality of medical care. Milbank Mem Fund Q 1966 Jul;44(3):Suppl:166-Suppl:206. [Medline]
- Holzemer WL, Reilly CA. Variables, variability, and variations research: implications for medical informatics. J Am Med Inform Assoc 1995 Jun;2(3):183-190 [FREE Full text] [Medline]
- Sweidan M, Reeve JF, Brien JA, Jayasuriya P, Martin JH, Vernon GM. Quality of drug interaction alerts in prescribing and dispensing software. Med J Aust 2009 Mar 2;190(5):251-254. [Medline]
- de Lusignan S, Teasdale S, Little D, Zapp J, Zuckerman A, Bates DW, et al. Comprehensive computerised primary care records are an essential component of any national health information strategy: report from an international consensus conference. Inform Prim Care 2004;12(4):255-264. [Medline]
- de Lusignan S. The optimum granularity for coding diagnostic data in primary care: report of a workshop of the EFMI Primary Care Informatics Working Group at MIE 2005. Informatics in primary care 2006;14(2):255-264.
- de Lusignan S, Teasdale S. Achieving benefit for patients in primary care informatics: the report of a international consensus workshop at Medinfo 2007. Inform Prim Care 2007;15(4):255-261. [Medline]
- Ellis B. Complexity in practice: understanding primary care as a complex adaptive system. Inform Prim Care 2010;18(2):135-140. [Medline]
- Pearce C, Phillips C, Hall S, Sibbald B, Porritt J, Yates R, et al. Following the funding trail: financing, nurses and teamwork in Australian general practice. BMC Health Serv Res 2011;11:38 [FREE Full text] [CrossRef] [Medline]
- Department of Health and Ageing. Practice Incentives Program URL: http://www.medicareaustralia.gov.au/provider/incentives/pip/index.jsp [accessed 2013-04-25] [WebCite Cache]
- Royal Australian College of General Practitioners. The RACGP Curriculum for General Practice. Melbourne: RACGP; 2011.
- McInnes DK, Saltman DC, Kidd MR. General practitioners' use of computers for prescribing and electronic health records: results from a national survey. Med J Aust 2006 Jul 17;185(2):88-91. [Medline]
- Pearce C. Electronic medical records--where to from here? Aust Fam Physician 2009 Jul;38(7):537-540 [FREE Full text] [Medline]
- Davies K. The information-seeking behaviour of doctors: a review of the evidence. Health Information and Libraries Journal 2007:1.
- Harvey KJ, Vitry AI, Roughead E, Aroni R, Ballenden N, Faggotter R. Pharmaceutical advertisements in prescribing software: an analysis. Med J Aust 2005 Jul 18;183(2):75-79. [Medline]
- Henderson J, Miller G, Pan Y, Britt H. The effect of advertising in clinical software on general practitioners' prescribing behaviour. Med J Aust 2008 Jan 7;188(1):15-20. [Medline]
- Sweidan M, Reeve JF, Brien JA, Jayasuriya P, Martin JH, Vernon GM. Quality of drug interaction alerts in prescribing and dispensing software. Med J Aust 2009 Mar 2;190(5):251-254. [Medline]
- Ammenwerth E, Schnell-Inderst P, Machan C, Siebert U. The effect of electronic prescribing on medication errors and adverse drug events: a systematic review. J Am Med Inform Assoc 2008;15(5):585-600 [FREE Full text] [CrossRef] [Medline]
- Pearce C, Shachak A, Kushniruk A, de Lusignan S. Usability: a critical dimension for assessing the quality of clinical systems. Inform Prim Care 2009;17(4):195-198. [Medline]
- Ash JS, Berg M, Coiera E. Some unintended consequences of information technology in health care: the nature of patient care information system-related errors. J Am Med Inform Assoc 2004 Apr;11(2):104-112 [FREE Full text] [CrossRef] [Medline]
- Pearce C, Arnold M, Phillips CB, Trumble S, Dwan K. The many faces of the computer: an analysis of clinical software in the primary care consultation. Int J Med Inform 2012 Jul;81(7):475-484. [CrossRef] [Medline]
- Pearce C, Shearer M, Gardner K, Kelly J. A division's worth of data. Aust Fam Physician 2011 Mar;40(3):167-170 [FREE Full text] [Medline]
- Blankers M, Koeter MW, Schippers GM. Missing data approaches in eHealth research: simulation study and a tutorial for nonmathematically inclined researchers. J Med Internet Res 2010 Dec;12(5):e54 [FREE Full text] [CrossRef] [Medline]
- Stewart M, Brown J, Weston W, McWhinney L, McWilliam C, & Freeman T. Patient-centered Medicine: Transforming the Clinical Method: Transforming the Clinical Method (Patient-Centered Care Series). Oxford: Radcliffe Medical Press; 2003.
- Potter SJ, McKinlay JB. From a relationship to encounter: an examination of longitudinal and lateral dimensions in the doctor-patient relationship. Soc Sci Med 2005 Jul;61(2):465-479. [CrossRef] [Medline]
- Pearce C, Arnold M, Phillips C, Trumble S, Dwan K. The patient and the computer in the primary care consultation. J Am Med Inform Assoc 2011 Apr;18(2):138-142 [FREE Full text] [CrossRef] [Medline]
- Reason J. Human error: models and management. BMJ 2000 Mar 18;320(7237):768-770 [FREE Full text] [Medline]
- Hannan A. Providing patients online access to their primary care computerised medical records: a case study of sharing and caring. Inform Prim Care 2010;18(1):41-49. [Medline]
- Swindells M, de Lusignan S. Lessons from the English National Programme for IT about structure, process and utility. Stud Health Technol Inform 2012;174:17-22. [Medline]
- de Lusignan S, Seroussi B. A comparison of English and French approaches to providing patients access to Summary Care Records: scope, consent, cost. Stud Health Technol Inform 2013;186:61-65. [Medline]
- Elliot-Smith A, Morgan MA. How do we compare? Applying UK pay for performance indicators to an Australian general practice. Aust Fam Physician 2010 Feb;39(1-2):43-48 [FREE Full text] [Medline]
- Stevens PE, Farmer CK, de Lusignan S. Effect of pay for performance on hypertension in the United kingdom. Am J Kidney Dis 2011 Oct;58(4):508-511. [CrossRef] [Medline]
- Horsfield P, Teasdale S. Generating information from electronic patient records in general practice: a description of clinical care and gender inequalities in coronary heart disease using data from over two million patient records. Inform Prim Care 2003;11(3):137-144. [Medline]
- Avery AJ, Savelyich BS, Teasdale S. Improving the safety features of general practice computer systems. Inform Prim Care 2003;11(4):203-206. [Medline]
- Carpenter I, Ram MB, Croft GP, Williams JG. Medical records and record-keeping standards. Clin Med 2007 Aug;7(4):328-331. [Medline]
- Duftschmid G, Chaloupka J, Rinner C. Towards plug-and-play integration of archetypes into legacy electronic health record systems: the ArchiMed experience. BMC Med Inform Decis Mak 2013;13:11 [FREE Full text] [CrossRef] [Medline]
- Hoerbst A, Ammenwerth E. Quality and Certification of Electronic Health Records: An overview of current approaches from the US and Europe. Appl Clin Inform 2010;1(2):149-164. [CrossRef] [Medline]
- Yusof MM, Kuljis J, Papazafeiropoulou A, Stergioulas LK. An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit). Int J Med Inform 2008 Jun;77(6):386-398. [CrossRef] [Medline]
- Lau F, Price M, Keshavjee K. From benefits evaluation to clinical adoption: making sense of health information system success in Canada. Healthc Q 2011;14(1):39-45. [Medline]
- Shabot MM. Ten commandments for implementing clinical information systems. Proc (Bayl Univ Med Cent) 2004 Jul;17(3):265-269 [FREE Full text] [Medline]
|CMR: computerized medical records|
|EHR: electronic health record|
|GP: general practitioners|
|HL-7: Health level-7|
|ICD-10: International Classification of Disease version 10|
|NHS: National Health Service|
|PBS: Pharmaceutical Benefits Scheme|
Edited by G Eysenbach; submitted 03.05.13; peer-reviewed by M Bainbridge, A Shachak; comments to author 11.06.13; accepted 04.07.13; published 12.08.13
©Christopher Martin Pearce, Simon de Lusignan, Christine Phillips, Sally Hall, Joanne Travaglia. Originally published in Interactive Journal of Medical Research (http://www.i-jmr.org/), 12.08.2013.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Interactive Journal of Medical Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.i-jmr.org, as well as this copyright and license information must be included.