this post was submitted on 22 May 2026
566 points (99.0% liked)

Technology

84866 readers
5303 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] nbsp@programming.dev 11 points 7 hours ago (1 children)

ollama or llama.cpp to self host if you have a good mac or good video card. this is perfectly safe.

there are a bazillion hosted inference providers to choose from https://huggingface.co/docs/inference-providers/en/index be aware that you are sending your code to fuck knows who and they are sending back fuck knows what. ymmv, yolo.

hook one of them up to opencode.ai or pi.dev or one of the bazillion other 'harneses' or whatever we are calling it this week and try not to rm -r anything important.

for a good time try and get a chinese models to say something about tibet, or taiwan... its like having your own virtual tankie tamagochi!

[–] FlyingCircus@lemmy.world 12 points 6 hours ago (2 children)

be aware that you are sending your code to fuck knows who and they are sending back fuck knows what

So literally the same as Western-made AI?

[–] motruck@lemmy.zip 3 points 4 hours ago (1 children)

Yeah only the Chinese government is currently far better at working behind the scenes with companies than any other government in the world?

Incompetence is a feature of governments at times.

[–] FlyingCircus@lemmy.world 0 points 3 hours ago

I trust the Chinese government more than American tech corporations. One side is socialist, the other side is fascist.

[–] nbsp@programming.dev 3 points 6 hours ago

inference providers could be anyone from anywhere, there are even proxy resellers. some are harvesting and reselling your data.

if you send your code to claude/openai/google there is certainly a much higher degree of confidence in who you are sending your data to. yes they to harvest your data and can send you malicious commands (esp if you have a promp injection attack).

its like buying a cheap vps, if the stakes are low its fine, if it important then you need to consider about the consequences of your actions.

nb: i am no expert, just fucking around.