The first rule of any technology used in a business is that automation applied to an efficient operation will magnify the efficiency. The second is that automation applied to an inefficient operation will magnify the inefficiency.
-Bill Gates
You need AI to reword this spaghetti of an article. I know plenty of nurses, most of them shouldn’t be making decisions.
But I do agree that slapping AI on everything is a poor idea.
Hasn’t AI already been shown to be better at catching things like cancer than humans?
There are some things that computers can be better at than humans.
Machine learning for helping a radiologist analyze images is super helpful and a mature field.
Whatever “AI” LLM nonsense tech bros are trying to add in to everything in the last 2 years is probably not all that helpful, but i could be proven wrong
Yes! And we should use it when it has been proven effective. But the AI shouldn’t be able to administer drugs.
For sure. There always needs to be a human in the loop. But this notion people seem to have that all AI is completely worthless just isn’t true.
What’s scary is the hospital administration that will use AI to deny care to unprofitable patients (I’ve listened in on these conversations).
Where’s anyone saying it’s worthless? That’s not in the article nor in these comments.
The issue is how it’s being used. It’s not being used to detect cancer. It’s being used for “efficiency”, which means more patients being seen by fewer nurses. It’s furthering the goals of the business majors in hospital administration, not the nurses or doctors who are caring for the patient.
LLMs are largely worthless (in the context of improving human society).
Neural Nets aimed at much more specific domains (recognizing and indicating metastases or other abnormalities in pathology slides for human review, for example) are EXTREMELY useful and worthwhile.
Ai nearly everywhere is to improve efficiency, less people become more productive so that the owners keep more money. Because a pay rise because of it is off the books. Since now you need to be “less skilled” anyway.
It’s also been shown to hallucinate whole parts of the doctor/nurse discussion and instructions
Yes… well, sorta. For example, AI was found to be better at identifying TB than medical doctors. The catch here is that it also falsely diagnosed st a much higher rate than doctors. When an investigation was done as to how the AI was evaluating the imaging that it was given, they found that sets of virtually indistinguishable images were given different diagnoses by the AI. In many cases where there were no visible indicators of TB, a positive diagnosis wss given. The reason for this is that the AI was not weighting their TB diagnosis based on markers that doctors would look for alone, but also the age of the machine. Older machines have a much greater chance of being located in developing countries where TB is both more common and more deadly, leading to the age of the machine being considered an important factor, whereas a human would know that the age of a machine has absolutely zero relationship with the chance of getting TB, and doctors in these areas are already aware of and watching out for TB as it’s a much more serious illness than in Germany, for example.
Idk much about the cancer thing, but basically the machine learning for diagnosis thing is iffy at best afaik.
Dogs are can be also better at detecting cancer than humans. And dogs tend to hallucinate less
Hallucinations aren’t a problem with the actually medically useful tools he’s talking about. Machine learning is being used to draw extra attention to abnormalities that humans may miss.
It’s completely unrelated to LLM nonsense.
Perhaps, we should consider not calling all of them as AI. Machine learning is a useful tool.
“AI” long predates LLM bullshit.
You are right. My pet peeve is that it is now used as a marketing term without actual meeting. Used to be the word smart. Now instead of “buy this smart toaster”, “buy this AI powered toaster”. Sorry if this reply was too verbose for your liking.
They’re better at smelling cancer than humans.
I’m not sure we can definitively say they hallucinate less.
There is a company hospitals have hired to transcribe recordings. The software makes many transcription errors and then deletes the original audio. Things aren’t looking good.
Shitty software existed before AI too. Things have always looked bad in hospitals.
This conversation has been edited
You need AI to reword this spaghetti of an article
I love it when writers editing the words of others somehow can’t pass grade-school writing classes.
?
know plenty of nurses, most of them shouldn’t be making decisions.
Do expect doctors to do it or something?
To make the decisions for the patient? Uhh yeah. And they do. Check the chart.
"The reasoning for bringing in AI tools to monitor patients is always that it will make life easier for us, but in my experience, technology in healthcare rarely makes things better. It usually just speeds up the factory floor, squeezing more out of us, so they can ultimately hire fewer of us. " - yup and there’s not much we can do about it without harming a lot of people.
Yay we don’t have to work anymore! Good news right? Right?!
/s
Excellent article.
