141
Health Care AI, Intended To Save Money, Turns Out To Require a Lot of Expensive Humans.
(kffhealthnews.org)
this post was submitted on 10 Jan 2025
141 points (98.0% liked)
Technology
60354 readers
5059 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Yeah…what we have today as “AI” makes a ton of mistakes. Well, maybe not a ton, but enough that it cannot be relied on without a human to correct it.
I use it as a foundation at work.
I often, like 98% of the time, won’t get what I asked for or will get something that it interpreted incorrectly. It’s common sense to me but maybe not to others to not run whatever it spits out blindly. Review what it outputted, then test it somewhere. I often create a similar file structure somewhere else and test there and then after a few tests and reviewing and making modifications, then I feel comfortable running whatever it spit out to me.
But I don’t think I’ll ever not double check whatever any type of AI spits out as a response to me for whatever I’ve asked. Humans should always have the last word before action, especially when it comes to healthcare.
I wouldn't go so far as to say I have the opposite experience but it's been good for me when I treat it like a junior developer. If you give them freedom to come up with the solution they'll totally miss the point. If I give them direction on a small piece of functionality with clear inputs and outputs then they'll get 90% of the way there.
So far I think AI is a good way to reduce mundane work but coming up with ideas and concepts on it's own is a bridge too far. An example of this is a story I read about a kid committing suicide because of an AI driven fantasy. It was so focused on maintaining the fantasy it couldn't step back and say, "Whoa. This is a human being I'm talking to and they're talking about real self-harm. I think it's time to drop the act." This will result in people being treated as financial line items (moreso) and new avenues for cyber attacks.