Honest title: lazy analyst pretends to be smart recycling an overused Gartner graph
this post was submitted on 10 Oct 2023
148 points (94.0% liked)
Technology
72360 readers
2945 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
an overhyped thing won't be as hyped in the near future?
who would've thunk
We're getting customers that want to use LLMs to query databases and such. And I fully expect that to work well 95% of the time, but not always, while looking like it always works correctly. And then you can tell customers a hundred times that it's not 100% reliable, they'll forget.
So, at some point, that LLM will randomly run a complete non-sense query, returning data that's so wildly wrong that the customers notice. And precisely that is the moment when they'll realize, holy crap, this thing isn't always reliable?! It's been telling us inaccurate information 5% of the usages?! Why did no one inform us?!?!?!
And then we'll tell them that we did inform them and no, it cannot be fixed. Then the project will get cancelled and everyone lived happily ever after.
Or something. Can't wait to see it.
Would you trust a fresh out of college intern to do it? That's been my metric for relying on LLM's
Yup this is the way to think about LLMs, infinite eager interns willing to try anything and never trusting themselves to say "I dont know"
It might actually help the intern if they use it:
You’re right but it’s worse than that. I have been in the game for decades. One bum formula and the whole platform loses credibility. There isn’t a customer on the planet who’ll look at us as 5%.
Seeing people say they’re saving lots of time with LLMs makes me wonder how much menial busywork other people do relative to myself. I find so few things in my day where using these tools wouldn’t just make me a babysitter for a dumb machine.
It’s great for programming and writing formal messages. I never know where to get started on messages so I give the AI a summary of what I’m trying to say. That gives me a very wordy base to edit to my liking.
It's great for writing latex.
latexify
sum i=0 to n ( x_i dot (nabla f(x)) x e_r) = 0
\[
\sum_{i=0}^{n} \left( x_i \cdot (\nabla f(x)) \times e_r \right) = 0
\]
Also great at postioning images and fixing weird layout issues.
You don't need a LLM for converting pseudo code to Latex. LLMs surely help at programming (in my experience), but I feel like your example is really giving them justice :p
Yeah... as a Product Manager, dealing with a lot of text based tasks, I really expected to find it more useful than I actually have. I've not really been able to use it for writing documentation and sending emails, because it matters to me what is in those and I have something I want to say in them.
The only way I could really consider offloading these tasks to AI is if I just stopped caring what went in them.
I use AI all the time in my work. With one of my tools I can type in a script and have a fully-acted, fully-voiced virtual instructor added to the training we create. Saves us massively in both time and money and increases engagement.
This is how AI will truly sweep through the market. Small improvements, incrementally developed upon, just like every other technology. White collar workers will be impacted first, with blue collar workers second, as the technology continues to develop.
My friend is an AI researcher as part of his overarching role as an analyst for a massive insurance company, and they're developing their own internal LLM. The things AI can do will be absolutely market-shattering over time.
Anyone suggesting AI is just a fad/blip is about as naive as someone saying that about the internet in 1994, in my view.
load more comments
(8 replies)
2024 headline: "Analyst replaced by generative AI"
In the mean time, I'm using chat gpt at work every day now and I'm able to work much faster because of it.
To me it's next generation search engine. For tech queries it's correct a lot.
Pretty much every tech question I ask it it just refers the answer to the "Your IT Administrator" which isn't helpful.
Once it stops giving non-existent powershell commands, I'll give it another go, but for now it has wasted enough of my time.
or non-existent switches for linux cli commands
The worst part is how eager it is to give you a non-existent switch or cli option. Like if it gives you some multi-line solution, all you have to do is say something like "are you sure there's not an option where I can do this in one line?" And it'll be like, "oh yeah you're totally right, you can just use this non-existent thing that totally won't work! Sorry about the confusion!"
I'm finding it useful for detecting / correcting really simple mistakes, syntax errors and stuff like that.
But I'm finding it mostly useless for anything more complicated.