Princess Health and The Future Pathways for e-Health in NSW .Princessiccia

Princess Health and The Future Pathways for e-Health in NSW .Princessiccia

Healthcare IT experiment Healthcare IT failure Jon Patrick

Gusty 05:16 Add Comment

Prof. Patrick has now added a new section to his report on health IT in NSW Australia, entitled "The Future Pathways for e-Health in NSW." It is available at this link (PDF).

It inoculates against most of the 'Ten Plagues' that bedevil health IT projects (such as the IT-clinical leadership inversion, lack of transparency, suppression of defects reporting, magical thinking about the technology, and lack of accountability of the bureaucrats).

Emphases mine:

In Short Term ( 0-3 months)

1. Halt further rollouts of Firstnet or other CIS systems. The current roll-out programs use significant efforts in training staff for a system that is counterproductive to patient well being.
2. Complete a full and thorough risk assessment analysis and usability of the software. The CIS report indicates there are a number of risks in the current software that are not likely to have been assessed in the past.
3. Address the current problems before doing anything else. There are a number of problems that appear solvable in the short term that would improve the situation for current users, such as providing needed reports.
4. Create the NSW IT Improvement Panel composed of ED Directors, IT-savvy clinical and quality improvement staff responsible for advising on the preparedness and process of the rollout.
5. Create an effective error and bug reporting mechanism that is viewable by all ED directors and with the display of the priority of each entry and expected completion time.
6. Initiate a high profile campaign to encourage staff to lodge fault records on anything they discover wrong, problematic or inefficient in using the system.

In the longer term (3-12 months)

1. Review the Health Support Services and make it clinically accountable by appointing a clinical head with an IT education.
2. Create a culture change in the HSS. The current operation of the HSS seems to be devoid of influence from the clinical community.
3. All NSW CIS system procurement should be guided by an IT Advisory Board of IT experienced clinical, academic and medical software industry experts.
4. Create pathways for hospitals that wish to be early adopters and take a lead role in the development of new methods for using and deploying IT systems.
5. Support innovation within the Australian medical software communities that contribute to a culture of innovation and continuous quality improvement.
6. Adopt transparency rules in all new healthcare information acquisitions. Secrecy has bedevilled the efforts of staff and management to get improvements in the CIS systems and hold service agents accountable for their failure to comply to service level agreements. All agreements about a signed contract should be available to the ED Directors.
7. Replace the State Based Build policy with a policy of providing a technology to match the technology experience of the individual departments so that leaders are not dragged backwards with inappropriate technology installation

The de facto "National Program for IT in the HHS" here in the United States needs a similar inoculation.

I can only add that our own ONC office (Office of the National Coordinator for Health IT of the Dept. of HHS) had more granular recommendations about expertise levels required for leadership roles in such undertakings. I wrote about them at my Dec. 2009 post "ONC Defines a Taxonomy of Robust Healthcare IT Leadership."

--SS

Princess Health and Are Those Sockpuppers From Down Under? .Princessiccia

Princess Health and Are Those Sockpuppers From Down Under? .Princessiccia

Australian Health Information Technology Blog Jon Patrick sockpuppet

Gusty 20:48 Add Comment

We at Healthcare Renewal have had experience with the healthcare sock puppets. They are shills, a person or group working on behalf of a company or other special interest. They attempt to use distraction, ad hominem, misdirection and other psyops tactics to attack points of view they don't like. They also plant memes they or their sponsor deem desirable.

They are universally anonymous in their postings.

One got careless and got nailed via IP forensics, as at my Jan. 2010 post "More on Perversity in the Healthcare IT World: Is Meditech Employing Sockpuppets?" and my semi-satirical followup post a few days later, "Socky the Meditech Sockpuppet on Vacation?" after he/she disappeared after exposure.

A Healthcare Renewal reader with an MBA at that time non-anonymously related the following (emphases mine):

In reading this thread of comments I have to believe IT Guy [the Sock puppet - ed.] is a salesperson. My only question is: Were you assigned this blog or did you choose it? We had this problem a number of years ago where a salesperson was assigned a number of blogs with the intent of using up valuable time in trying to discredit the postings.

In my very first sales class we learned to focus on irrelevant points, constantly shift the discussion, and generally try to distract criticism. I would say that HCR is creating heat for IT Guy�s employer and the industry in general.

I find it sad that a company would allow an employee to attack anyone in an open forum. IT Guy needs to check with his superiors to find out if they approve of this use of his time, and I hope he is not using a company computer, unless once again this attack is company sanctioned.

Steve Lucas

It seems this foul type of creature is starting to crawl out of the woodwork regarding Prof. Jon Patricks' analysis of an ED EHR system mandated by the state's government of NSW for public hospitals, as I wrote about in my posts such as on Mar. 5, 2011 at "On an EMR Forensic Evaluation by Professor Jon Patrick from Down Under: More Thoughts.".

They may be corporate, they may be government. They likely have a financial stake in the ED EHR project as well.

For instance, the sockpuppet/shill comments are starting to appear at the Australian Health Information Technology blog of Dr David More MB, PhD, FACHI at http://aushealthit.blogspot.com:

This blog has only three major objectives.

The first is to inform readers of news and happenings in the e-Health domain, both here in Australia and world-wide.

The second is to provide commentary on what seems to have become the lamentable state of e-Health in Australia and to foster improvement.

The third, sadly, is now to try and force accountability for the actions of, and the funds spent, by NEHTA. [National E-Health Transition Authority as at this link - ed.]

(Sounds like a kindred mission relative to HC Renewal.)

For instance at Dr. More's post "Prof Patrick Has Really Hit the Bullseye It Would Seem. Lots of Supportive Comments From All Over!" we see the following sock puppet-like comments rearing their holey (not holy) woven head:

... It seems that the heuristic axiom of Ockham�s Razor (as presented by Jon) is the design criteria by which Jon thinks NSW Health should have selected their CIS ... unbelievable!

Unfortunately Jon has not proposed any practical alternatives in his papers. His papers are full of opinions, unfounded claims and incorrect facts (not to mention the countless flaws in his research methodologies).

and

Dr Patrick - you are so misinformed. There are so many untruths in what you report. Why is this? Because you interviewed 7 people. Being Directors, what is the likelihood they are hands on with the system? Minimal I would say from experience in the EDs. Call yourself a researcher - huh! It is a totally biased report which reflects the opinions of those with an axe to grind. Why don't you talk to some nurses,clerical staff and junior doctors? There are hundreds of them working in EDs across the state. Their opinion should matter as they are the ones caring for our patients. You should be ashamed of yourself! I certainly would not hire you to do a research project if this is the biased and blatantly incorrect rubbish that you come up with. Shame on you!!

and the ever-so-common refrain of:

Has Dr Patrick ever completed (or even been involved in) an implementation of an EMR (at all or of any scale)? Can someone tell us what makes him an authority the subject? [I, OTOH, have done so, authoring, implementing, managing for hospitals and major pharma - ed.]

... His view is unbalanced and his paper is clearly bias. How Sydney University tolerates papers of such poor quality and biasness (being published by their professors) is beyond me. [Paper is 'clearly bias'? Biasness? This person needs a grammar lesson - ed.]

Ink is never put to specifics of the supposed transgressions in these largely ad hominem, anonymous attacks.

If those who wrote them had the fortitude to identify themselves, perhaps they might be somewhat credible. However that rarely if ever is the case.

In my humble opinion, such comments are risible, not even worth the electrons they're written with.

Except for amusement:

Socky the Health IT Sockpuppet. Click to enlarge.

p.s. an ED EHR-injured relative of mine has a message to the sockpuppets of the world. It's not fit for a public site, but it has to do with travel to a very hot, deep, sulfurous place in the earth.

-- SS

Princess Health and EHR ED's in New South Wales. Will the Problems Magically "Disappear?" .Princessiccia

Princess Health and EHR ED's in New South Wales. Will the Problems Magically "Disappear?" .Princessiccia

healthcare IT defects healthcare IT difficulties Jon Patrick

Gusty 15:36 Add Comment

It occurs that one could look at Prof. Jon Patrick's recent health IT forensic analysis as a kind of "indictment" of the industry.

He can be seen as suggesting the industry needs to be "put on trial" (figuratively) regarding "crimes" (again, figuratively speaking) they've committed with regard to IT robustness and reliability. The latter translate directly to patient safety.

In a lawsuit such as a medical malpractice trial, obvious as well as potential evidence is put under "legal hold." For instance, if an EHR defect is suspected, metadata, audit trails, and patient data are asked (or should be asked) to be frozen or archived in the state they were in at the time of the alleged accident.

It can take a page or three (or more) of specifications simply to define what information, exactly, needs to be put on legal hold. My former staff were frequently required to place myriad materials on legal hold at Merck Research Labs, for example, baed on the lawsuit du jour.

Once frozen, discovery and forensic analysis of these now-static data can then proceed. In fact, cases can be lost on the basis of evidence of an archiving omissions, destruction or tampering when information holds are requested.

It occurs to me that Prof. Patrick has given the industry a detailed look into factors they could start to remediate, without publicity and without telling anyone. While this would be a net plus for patients, it might result in less of a learning experience to the industy than that industry needs, to motivate the industry to avoid future product engineering and quality issues and put quality (not simply margin) as priority #1.

I therefore would believe a "hold" put on the present state of these ED EMR systems, or a "snapshot" of their current state (i.e., an evaluation environment mirrored from the present operational one) would allow a careful evaluation of the impact of the issues noted in the study.

Such an evaluation would be far more difficult with a cybernetic moving target.

The "snapshot" idea would allow evaluation of system risk levels, intermittent "glitches", interference with workflows, etc. in a controlled testing environment, using mock data or data drawn from actual cases.

The "snapshot" approach would also allow incremental remediation of the "live" system that comes out of safe, controlled testing, rather than sticking with what exists now until the studies could be completed on the as-is system, and then applying all the fixes as one or more large "upgrades."

I, for one, would be interested in studying this "built by software professionals" system and comparing it to health IT systems we "academic nerds" were authoring, say, 10-15 years ago.

-- SS

Princess Health and Australian ED EHR Study: An End to the Line "Your Evidence Is Anecdotal, Thus Worthless?" .Princessiccia

Princess Health and Australian ED EHR Study: An End to the Line "Your Evidence Is Anecdotal, Thus Worthless?" .Princessiccia

AMIA healthcare IT anecdote Jon Patrick OHSU William Hersh

Gusty 06:55 Add Comment

At my Sept. 2010 post "The Dangers of Critical Thinking in A Politicized, Irrational Culture" I lamented that while my early mentor in biomedicine Victor P. Satinsky MD taught the wise credo "critical thinking always, or your patient's dead" in the 1970's, our culture had become so perverse that this credo had been largely supplanted with:

"Critical thinking anytime, and your career's dead."

That post was in reaction to continued heckling on a professional mailing list, the American Medical Informatics Association (AMIA) Clinical Information Systems Working Group (cis-wg). On this list, Oregon Health Sciences University professor William Hersh expounded on how the evidence of health IT dangers was largely "anecdotal" therefore to be discounted, and how I, specifically, "didn't know the literature on health IT."



In that post I put the lie to the latter figment. On the former prevarication Dr. Jon Patrick, author of the recent thorough dissection of problems with the ED EHR system being rolled out in public hospitals in New South Wales, Australia (see my Mar. 5, 2011 post "On an EMR Forensic Evaluation by Professor Jon Patrick from Down Under: More Thoughts"), hit the ball out of the park:

Prof. Patrick to AMIA cis-wg:



I think such defences are particularly unuseful especially with respect to the dismissal of personal stories and experiences as "anecdotes", hence committing them to the realm of folklore. I offer these notions as a counterpoint.



Discounting Anecdotes:



1. Is a perfidious and specious act.



2. It denies early warning signs of problems.



3. It denies a voice and disempowers the working clinical community who have to operationalise decisions made by others.



4. It denies a route to process improvement within an institution - which is most important for EBM and incremental review of local processes.



5. It defends software manufacturers from fault rectification - cuts off even a need to deliberate on it. Critics of the value of anecdotes are squarely on the side of the faulty and deficient manufacturer.



6. A rule of project management is that projects consist of 3 components, cost, quality and time and if their needs to be a compromise it has to be on quality. Anecdotes are early warning signs of such a compromise.

Prof. Patrick had to once again put the lie to this refrain at a comment on the HISTalk blog yesterday, where the anonymous proprietor had written in a review of Patrick's EHR study:

... On the other hand, I wouldn�t say it�s [Prof. Patrick's Cerner FirstNet study] necessarily unbiased, it focuses on implementation of a single department application that didn�t go well for a variety of reasons (despite many successful FirstNet implementations elsewhere), it uses the unchallenged anecdotal comments of unhappy users who make it clear they liked their previous EDIS better, and it nitpicks (I wasn�t moved to find a pitchfork when I learned that the primary keys in the Millennium database aren�t named consistently).



[Considering the complexity and changeability of healthcare and the corresponding software lifecycle, I duly note that that latter attitude about 'failing to find pitchforks' regarding breaches of sound software engineering practices seems to be a symptom of the larger health IT disease that Prof. Patrick writes about - ed.]

Dr. Patrick then knocked the ball out of the Southern Hemisphere with a comment of his own about anecdotalism and a link to an expansion of the aforementioned ideas he'd shared on "discounting anecdotes":

Prof. Patrick to HISTalk owner:



Your Comment �it uses the unchallenged anecdotal comments of unhappy users � is not only unfair but unreasonably inaccurate. The comments made by the users are the Directors of 7 EDs and so they have a right to carry authority by virtue of the experience but also the number of 6 out 7 presenting a view of Firstnet as unfit for purpose has numeric validity, which they justify with about 20+ pages of their comments � see Part 2 Appendix 2.



I would also point readers to my editorial about the role of personal experiences being the most useful information to understand the nature of socio-technical failures. http://aci.schattauer.de/en/contents/archive/issue/1124/manuscript/15463/show.html

The essay at that link, "The Validity of Personal Experiences in Evaluating HIT", is an editorial in Johns Hopkins informaticist Chris Lehmann's brilliant new journal "Applied Clinical Informatics."



The editorial is available free, and is a must-read for anyone in a decision-making or managerial role in mission critical domains, including our elected representatives.



In the editorial Dr. Patrick concludes. similarly to his earlier AMIA mailing list opinion:

... the denial of recounted personal experiences in discussion and analysis of HIT is biased and specious and has the effect of:



1. Denying early warning signs of problems.



2. Denying a voice for the working clinical community who have to operationalise decisions made by others and thus disempowers them.



3. Denying process improvement within an institution � which is most important for Evidence Based Medicine and incremental review of local processes.



4. Discourages staff from engaging in any form of process improvement hence worsening the sense of disenchantment.



Every legitimate personal experience of a HIT deserves to be considered on its merits lest we wish to retreat from process and product improvement. Mechanisms of censorship both implicit due to contrived processes of disinformation and disempowerment or explicit due to contractual specifications will lead to more waste, lost productivity, contempt for the providers, and distress among frontline staff rather than increased productivity and improved patient health and safety as we all desire.

In my view, the drivers or motivators for the "anecdotalist" accusation are these, singly or in combination:

• Too much "education" to see the nose on one's face, as in, to think zebras and unicorns instead of horses when hearing hoofbeats outside one's midwest U.S. abode (eggheads);
  
  
• Too little common sense (fools), as in Scott Adams' example: "IGNORING ALL ANECDOTAL EVIDENCE - Example: I always get hives immediately after eating strawberries. But without a scientifically controlled experiment, it�s not reliable data. So I continue to eat strawberries every day, since I can�t tell if they cause hives";
  
  
• Too much concern for the possible interruption of flow of money or power in one's direction (gonifs).
  
  

In conclusion, the anecdotalist refrain of "your evidence is anecdotal" [therefore of little or no value] when used repetitively against competent observers is the refrain of eggheads, fools and gonifs.



In healthcare, the end result is "your patient's dead."



My "anecdotal relative" injured in a mid-2010 HIT mishap is sadly an example.



[June 2011 addendum: my relative, after much suffering, has now died of complications of the "anecdotal HIT mishap" - ed.]



As for myself, I am a Markopolist (see my Sept. 2010 post "Health IT: On Anecdotalism and Totalitarianism").



-- SS