This is a most excellent place for technology news and articles.
Everyone with domain specific knowledge*
Language models do not reason or weigh evidence or evaluate or weigh risks, they predict what words and phrases are most likely to come next. Reinforcement learning can train language models to make better predictions in specific circumstances, but it's not a substitute for conscious thought.
If a chatbot gives you bad advice, it's your responsibility to. If a lawyer gives you bad advice, it's the lawyer's responsibility.
I find it useless for even basic tasks. The fact that some people follow it blindly like a god is so concerning.
I only found one usecase where it shines and even then I had to verify the output twice to make sure it doesn’t fuck up before I push it into production. String manipulation is pretty good with it instead of having to write a bash one liner with a lot of sed and awk
It's great when I need a one-off powershell command or something basic like that.
I work in a health-care-adjacent industry and you’d be surprised how many people blindly follow LLMs for medical advice
A lot of people are very stupid, and also very easily tricked/conned.
We are basically just finding all the people who pretty much already were NPCs, and now, well, they're formalizing that.
To those people, well, the LLM probably just actually generally is more intelligent / informed than them.
George Carlin:
Imagine how stupid the average person is.
Now, realize half of all people are more stupid than that.
It’s been doing wonders to help me improve materials I produce so that they fit better to some audiences. Also I can use those to spot missing points / inconsistencies against the ton of documents we have in my shop when writing something. It’s quite useful when using it as a sparing partner so far.
Rule of thumb is that AI can be useful if you use it for things you already know.
They can save time and if they produce shit, you'll notice.
Don't use them for things you know nothing about.
LLM’s specifically bc ai as a range of practices encompass a lot of things where the user can be slightly more dumb.
You’re spot on in my opinion.
It's great when you have basic critical thinking skills and can use it like a tool.
Unfortunately, many people don't have those and just use AI as a substitute for their own brain.
Yeah well same applies for a lot of tools.. I’m not certified for flying a plane and look at me not flying one either… but I’m not shitting on planes…
But planes don't routinely spit out false information.
If you can’t fly a plane chances are you’ll crash it. If you can’t use llms chances are you’ll get shit out of it… outcome of using a tool is directly correlated to one’s ability?
Sound logical enough to me.
Except with a plane, if you know how to fly it you're far less likely to crash it. Even if you "can use LLMs" there's still a pretty strong chance you're going to get shit back due to its very nature. One the machine works with you, the other the machine is always working against you.
Nha that’s just plain wrong…also you can also fantastically screw flying a plane but so long you use LLMs safely you’re golden.
It also has no will on its own; it is not « working against you ». Don’t give those apps a semblance of intent.
If I'm canoeing upriver, the river is working against me. That doesn't mean it has a will. LLMs don't need to have a will to work against you if your goal is to get accurate information, because by its very design it is just as likely to provide innnacurate information based on the way the tokens it applies to your query are weighted. You cannot control that. Its not plain wrong. Jfc, you slop apologists are fucking delusional. AI doesn't magically work better for you because you're special and can somehow counteract its basic fucking design.
Slop apologist because I argue that correctly using a tool to restructure pre-existing information I’m inputting under my oversight is risk free?
You crazy ass end-of-world lunatic…
As far as I know slop always presupposes generation of derivatives, not restructuring or manipulation. You argue out of your ass and that’s just a bad opinion.
Sure. However, the outcome of the tool LLM always looks very likely. And if you aren‘t a subject matter expert the likely expected result looks very right. That‘s the difference - hard to spot the wrong things (even for experts)
So is a speedometer and an altimeter until you reaaaaaaaaly need to understand them.
I mean it all boils down to proper tool with proper knowledge and ability. It’s slightly exacerbated by the apparent simplicity but if you look at it as a tool it’s no different.
Rearranging text is a vastly different use case than diagnosis and relevant information retrieval
I guess lawyers are feeling the pain that doctors experienced when WebMD became a thing.
That's not a new thing, doctors had this for at least a decade with WebMD.
No, you don't have cancer
I think my least favourite thing about AI is when customers tell me something won't take as long as I say, if I use AI. Look, if AI can do it why do you need me?
The fact I'm not out of a job (yet) is because apparently AI cannot do everything I can. The very second it can I'll be long gone.
So I am on the side of the lawyers here. For the first and only time.
Law in particular is such a gnarly subject that you really want to have someone who knows what they are saying about anything. And even then they can be wrong too
And at least they won't hallucinate past cases in front of a judge.
And it would have gotten away with it, if it weren't for that darn pesky judge!
Yes please. More folks need to all in on the idiocy of trusting an AI for legal advice. Let's get this public lesson over with.
This is one of the cases where they can simply be a hilarious example for the rest of us, rather than getting a bunch of the rest of us killed.
With a coding agent, it’s wrong a lot and the code is usually terrible, but it can get working code with proper tests to create a feedback loop.
How does that go with legal work? Well, turns out that was mostly made-up bullshit and the judge gave me a jail sentence for contempt of court, but once I get out, I’ll generate some more slop that will hopefully go over better next time.
Honestly if you are that dependent on A.I. now when it's still in a test phase then you are already lost, A.I. won't make us smarter if anything it has the opposite effect.
I'm watching that happen in my industry (software development). There's this massive pressure campaign by damn near everyone's employers in software dev to use LLM tools.
It's causing developers to churn out terrible, fragile, unmaintainable code at a breakneck pace, while they're actively forgetting how to code for themselves.
I find ai can turn out code fast - but then I spend a week or more turning it into good code and so the time saved isn't near as much. I'd be embarressd to call it my own and as a professional can't allow garbage-
Seems pretty simple to me, you pay lawyers so that you don’t have to pay even more by getting legally screwed over. Why try and cheap out on the insurance policy against bigger losses and risk it all collapsing?
[edit: sorry I ended up on a tangent]
Lawyers are no guarantee. They are sloppy because they have no skin in the game, and they usually get paid regardless (although some have "uplift" fees which reward them for winning).
It is like hiring builders for your renovation. You still have to keep an eye on them and even tell them how to do their job, which of course is always a tense situation. If you develop a good relationship you can work as a team (requires a lawyer who is not insecure).
Best avoid situations which need a lawyer. Do not litigate lightly. There is no such thing as a watertight case. If you get a corrupt judge they can outright lie, there is no point appealing, and you can be gagged from telling anyone (even your wife, let alone a politician or journalist).
People do Not make a difference. You can use it for Help, guidance or whatever.
But never, especially with law, Trust it. Fact Check.
Well. But Look at this cat playing a trombone.
I can't stand AI, but the few times I've used it, I've used it as a starting point. Once it gives me advice, I then go and confirm that with other sources. But I don't use AI much.
I had it cite a case which didn't exist. It was perfect for what I was fighting (it tends to figure out what you want to hear then makes up stuff to satisfy you).
When I tried to search for a phrase from the case (hoping it just gave the wrong citation) it said there was no such case with that phrase.
I asked why it said there was such a case earlier. It confessed that AI sometimes hallucinates and promised to try better in future.
Let's consider what you are doing on a purely abstract level.
We could also do the following:
You have keywords to type into forums.
That's great when you do, and you usually do, but sometimes you don't.
Case in point; A while back I was creating a 3D model for my 3D printer. It had a part that was essentially identical to a particular unusual pipe fitting that I have seen and knew existed, but didn't know the name of (spoiler: I'm not a plumber), and I wanted to give the sketch in the modeling software a proper name for the thing.
Just trying keywords that sort of described it's shape in search engines was useless. Search engines would focus more on the "pipe fitting" part of the keywords and just return links to articles about plumbing. Then I asked an LLM, and it responded with, "That sounds like X." Then I checked that it wasn't just making it up by searching for "X" and found online stores selling the very thing I was trying to figure out the name of.
Yes LLMs are good with finding terms and phrases that you can’t remember but are at the tip of your tongue
let them find out
