Real risk of our digital life – Obedience to AI

NYT article “Review: ‘The Digital Doctor’ by Robert Wachter Weighs Medicine’s Technological Transformation”  reminds us that we are facing a different kind of risk when instructions are computer generated. The risk we were facing or dealing in the past decade has evolved. Now, the real risk is human obedient to machine output! This example show machine to human interfaces are obstacles for human-to-human collaborations.

Imagine if the number of pills were hand-written, will the nurse enquired about the abnormal large amount? Computer screen and print-outs seems embedded  with some magical power.  Maybe people are not confident to challenge a computer. They are trained to trust it!

More people are blindly or mindlessly follow printed instructions. Sometimes they do have the confidence to challenge the computer’s decision or sometimes they do not know who or where to voice their concerns. The wide adoption of AI and computer-aided decision is new and we should encourage users to question or re-confirm.

extract:

“The other big problem behind the overdose was more cultural, and even harder to solve. In a setting in which all exchanges are digital, informal chat (“Do you believe the dose they just ordered?”) tends to vanish. Instead, everyone sits at an individual monitor, immersed in an individual digital world, tuning out the beeps.”

Leave a Reply

Discover more from A-INFOSEC

Subscribe now to keep reading and get access to the full archive.

Continue reading