nagaram

General Kenobi

(I can't help)

That's a shower thought of all time.

For simply productivity like Copilot or Text Gen like ChatGPT.

It absolutely is doable on a local GPU.

Source: I do it.

Sure I can't do auto running simulations to find new drugs and protein sequencing or whatever. But it helps me code. It helps me digest software manuals. That's honestly all I want

Also, massive compute projects for the @home project are good?

Local LLMs runs fine on a 5 year old GPU, a 3060 12 gig. I am getting performance on par with cloud ran models. I'm upgrading to a 5060ti just because I wanted to play with image Gen.

Whack. I just set up a Forgejo too.

Which is funny since that does solve a lot of the problems.

If it's completely open source at least.

Like OS data sets and model that can be ran locally means it's not trained on stolen data and it's not spying on people for more data.

And if it runs locally on a GPU, it's no worse for the environment than gaming. Really the big problem with the data center compute is the infrastructure of getting that data around.

Weird. There used to be screen shot receipts I saw years ago.

Maybe she scrubbed it and turned a leaf? I hope so at least because B'Elanna was my favorite character.

That's crazy.

Anyways I'm gonna pitch never buying a Samsung phone again to the HR people if this comes true.

I am a fan of LLMs and what they can do, and as such have a server specifically for running AI models. However, I've been reading "Atlas of AI" by Kate Crawford and you're right. So much of the data that they're trained on is inherently harmful or was taken without consent. Even in the more ethical data sets it's probably not great considering the sheer quantity of data needed to make even a simple LLM.

I still like using it for simple code generation (this is just a hobby to me so Vibe coding isn't a problem in my scenario) and corporate tone policing. And I tell people non stop that it's worthless outside of these use cases and maybe as a search engine, but I recommend Wikipedia as a better start almost Everytime.

I was honestly impressed with the speed and accuracy I was getting with Deepseek, llama, and Gemma on my 1660ti.

$100 used and it was seconds to get responses.

It's not a Lemmy thread without some Star Trek references

Robert Beltran (Chakotey), Roxan Dawson (B'Elanna), and Manu Intiravmi (Icheb).

All three of these actors fell off after ST:Voyager and became vile conservative shit posters. I know Robert especially likes to respond to anti Trump or anti Trump Policy tweets the other ex cast members make with "both sides" arguments.

It's sad in my eyes, but I do hold ST on a pretty high pedestal.

Gotta protect those Video Game movie deals.

Don't wanna risk that Ganon cast in the Zelda Movie

I am personally a huge fan of taking advantage of wealthy people.

You don't really have iPhone 16 pro Max and Air pods money to throw away like this without having a one sided relationship with labor, in my opinion.

But that's my cynical leftist view.

I imagine the biggest reason to not keep it is fear of your son getting spoiled or demanding gifts from you that are this same caliber.

However, he is 16. Certainly not the most rational age for many people, but he can understand the difference in financial statuses between you and his friend.

I think it would be distressing for you to take away this expensive thing on the grounds of "we're too poor to have nice things" especially since it was a gift from his best friend. But having that discussion of "hey don't let that get to your head. I still love you I just could not afford such an expensive gift. Here's a vague breakdown of our expenses"

My dad had a similar discussion with me when I was getting ready to go to college the first time and he flat out told me how much he and mom made and broke down where the money goes. It really helped me understand our economic position instead of just assuming my parents made a good amount of money (they didn't)