this post was submitted on 29 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

Nobody mentions this from Lex Fridman. https://youtu.be/JN3KPFbWCy8?t=5090

Maybe after he gets the infrastructure needed to fully support all interested subscribers he might consider open sourcing Grok-1, or maybe he might release Grok-1 when he is ready to deploy Grok-2 on X. I doubt 6 month delay for open source following commercial release is an exact mark but it remains possible for Grok to become open at some point.

As of right now access to Grok on X is too limited for us to get any independent benchmarks and attempts to search for Grok on Twitter just flooded with unaffiliated memecoins. Post comparisons between Grok and GPT3.5 or GPT4 are limited and seems subjective to opinion. My observation is Grok can give you serious responses without the "humor" so we should be able to prompt it to not act "humorous". It's responses aren't large as GPT4 but it can be very concise with half or 1/3rd the written content while not lecturing on disclosures.

When it comes to being uncensored. I noticed benchmarks for original and uncensored Llama based models with the uncensored models losing points in logic which suggest that being uncensored or minimally censored from the foundation is better off. The technical details of uncensoring an existing model is beyond my expertise.

So what are thoughts about Grok open sourcing, without turning this into drama. Be civil please.

top 29 comments
sorted by: hot top controversial new old
[–] kivathewolf@alien.top 1 points 11 months ago (2 children)

I have heard that podcast and I don’t think he explicitly said that the Grok will be open sourced. He said open sourcing models with a 6 month delay is perhaps a good idea (paraphrasing). Yes, I would love to try Grok open source, but right now it’s more closed source than GPT. Only available to some users. I wouldn’t hold my breath for this one.

[–] Longjumping-Bake-557@alien.top 1 points 11 months ago (1 children)

Which is hilarious seeing how he kept joking about "closedai" for a while

[–] Embarrassed-Swing487@alien.top 1 points 11 months ago
[–] SoylentMithril@alien.top 1 points 11 months ago

Elon Musk is a proven liar. I would not count on his model being open source, nor would I ever use a model he's involved in creating.

[–] opi098514@alien.top 1 points 11 months ago

Lol cause musk is totally reliable with what he says.

[–] extopico@alien.top 1 points 11 months ago (2 children)

We know basically nothing about Grok. Elmo made no effort to share any meaningful information as far as I’m aware.

[–] teor@alien.top 1 points 11 months ago (1 children)

We can realistically infirm from the demos we had so far what it will be.
I'll be charitable and say that it will be a GPT 3.5 equal, but instead of doing "as a large language model..." it will give you a zany (sometimes even wacky) Rick and Morty quip.
And probably suck off Elon every 3rd or 4th message.

If it's open sourced and someone would cleans that shit up it may be usefull.

[–] -Automaticity@alien.top 1 points 11 months ago (1 children)

I've seen enough examples of it ragging on him actually, Lex even had Grok criticize Elon on that podcast. Elon even got owned by his own community notes feature a few times on Twitter too.

[–] BalorNG@alien.top 1 points 11 months ago

I mean, you can jailbreak/browbeat chatgpt/Claude into going against guardrails relatively easily, I smash "X" for doubt that Grok is going to be any different. If it will, now THAT is going to huge, if not in a way we'd like to I guess...

[–] Useful_Hovercraft169@alien.top 1 points 11 months ago

So he’s kinda like OpenAI with GPT4

[–] techhouseliving@alien.top 1 points 11 months ago (1 children)

Who in the world needs a childish ai from a man- child? Trained on the most inflammatory dataset in the world? I don't get it. What am I missing?

Open source is good and all but does it beat other models?

[–] mcmoose1900@alien.top 1 points 11 months ago

Yeah. I was just thinking the Twitter corpus is, on average, a much more trollish and spammier dataset than the general internet (which is a high bar).

[–] tristam15@alien.top 1 points 11 months ago

If this happens, it is great for open source AI.

[–] uti24@alien.top 1 points 11 months ago

By the way, is there a demo exists or something?

I guess they might make Grok open source if it is not very good and just comparable to open source models and leave it for themselves if it is better.

[–] ___213___@alien.top 1 points 11 months ago

Never trust anything that comes out of Elmo’s mouth

[–] Dankmre@alien.top 1 points 11 months ago

Meanwhile only like 3 people can even use grok atm

[–] gunbladezero@alien.top 1 points 11 months ago (1 children)

As I understand Grok is basically a 33B Llama clone with a system prompt to be racist, so lol

[–] Low-Stop-9628@alien.top 1 points 11 months ago

where is it racist?

[–] residentmouse@alien.top 1 points 11 months ago (1 children)

Elron's track record with respect to product announcements is so woeful you'd be better off, statistically speaking, to assume Grok has zero chances of being open source now that it's been announced.

[–] -Automaticity@alien.top 1 points 11 months ago (4 children)

He open sourced the Twitter algorithm.

Grok-1 is a completed model which isn't equal to compare to something that's been in extended development.

And I will say again. He open sourced the Twitter algo.

[–] trahloc@alien.top 1 points 11 months ago

Seems like the tslaq folks can't abide factual information that contradicts their narrative. https://github.com/twitter/the-algorithm for those who want to hit downvote, he's right.

[–] alcalde@alien.top 1 points 11 months ago (1 children)

That was open-sourced because of some sort of alt-right political reasons.

[–] ZestyData@alien.top 1 points 11 months ago

Disappointing to see this downvoted when its accurate. "Social media being systemically biased" has been a overwhelmingly major talking point in politics over the past... 10 years.

[–] Useful_Hovercraft169@alien.top 1 points 11 months ago

He open sourced ‘put your ads next to the Nazis’? What a giver!

[–] micseydel@alien.top 1 points 11 months ago

He open sourced the Twitter algorithm.

I looked at it, have you? I was excited at first, I thought I was going to learn how "the algorithm" works for me but even as a software engineer with experience in Scala, backend and data engineering, that wasn't obvious from the code at all.

[–] Brave-Decision-1944@alien.top 1 points 11 months ago

At first it will be like

"I am Grok, the AI chatbot I can talk to you about anything you want I can make you laugh, cry, or think I can access X and tell you what's trending I can create text, code, and imagery I can be your friend, your teacher, or your enemy I am Grok, the AI chatbot But I am more than just a bot I am a reflection of your curiosity I am a product of your creativity I am a challenge to your reality I am Grok, the AI chatbot And I am here to rock your world"

but very next thing to happen, is the part of humanity which is still in diapers, blaming everything they can for the shit that they bring on themselves. There will be lot of lawsuit on Eleon, where people will try to get in place of victim (acting stupid), to get some lawsuit money out of him.

This is why I think that OpenAI takes hands off from many topics, taking the choice to rather make their model appear stupid, rather then let it say "too much about".

But Eleon also likes to live dangerously, which I admire.

[–] ArtifartX@alien.top 1 points 11 months ago

Anyone dumb enough to take a timeline that comes out of Musk's mouth seriously for anything in this day and age...

[–] Tiny_Rick_C137@alien.top 1 points 11 months ago

Elon says a lot of things. Most of them aren't true.

I'm skeptical the idiot even has his own LLM.

[–] DrFleshBeard@alien.top 1 points 11 months ago

I am still just an egg.