this post was submitted on 23 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
what is the best 7b right now ? (alien.top)
submitted 11 months ago by GasBond@alien.top to c/localllama@poweruser.forum
40 comments fedilink hide all child comments
 
  1. for coding
  2. for generating stories, writing email, poems etc.
  3. good overall
  4. etc.
you are viewing a single comment's thread
view the rest of the comments
[–] ModsAndAdminsEatAss@alien.top 1 points 11 months ago (2 children)

I haven't had a chance to get hands on with DeepSeek yet. How does it compare to Code Llama?

[–] danigoncalves@alien.top 1 points 11 months ago

I was actually today comparing both (codellama 7B) and man codellama just gave crap, deepseek was vey accurate.

[–] Illustrious-Lake2603@alien.top 1 points 11 months ago (1 children)

In my opinion it's amazing it's close to gpt4

[–] Dry-Vermicelli-682@alien.top 1 points 11 months ago

what hardware are you running it on? cpu/gpu, ram, etc? Trying to figure out what I need. My old gen 1 16 core threadripper with 64GB ram doesnt seem to work very well. Multiple minutes for a simple hello response. No GPU though, but looking to put a 6700XT GPU.. not sure if that GPU will help a lot or what.