Does it give refusals on base? 67B sounds like full foundation train.
this post was submitted on 29 Nov 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
Wow, this model seems very good for the Italian language!
I wish there was a 13b model which can just fit in on my GPU with quant
I made it write about itself using LocalAI https://sfxworks.net/posts/deepseek/
I will post a how-to on using local-ai on my free time if anyone is interested
I'm desensitized at this point. I wonder if this is yet another Pretraining on the Test Set Is All You Need marketing stunt or not, as most new models lately have been.
I threw my reasoning test questions at the web version and it performed worse than most 70B i tried. About the level of Yi.
Brother u/The-Bloke , can we get a quant of the uncensored base model too? ♥╣[-_-]╠♥
LoneStriker has a 2.4 bpw quant up: https://huggingface.co/LoneStriker/deepseek-llm-67b-chat-2.4bpw-h6-exl2
not that censored on local.
So.. Some censoring?
depepseek is one of my fav, i use it everyday for code generation. its got an extra option for the chat now at the link you shared, just general chat about anything, pretty good at it
if someone converts to gguf files and uploads them before bloke please post here thanks. (looking for q8).
- Grant of Copyright License. Subject to the terms and conditions of this License, DeepSeek hereby grants to You a perpetual, worldwide, non-exclusive, no-charge, royalty-free, irrevocable copyright license to reproduce, prepare, publicly display, publicly perform, sublicense, and distribute the Complementary Material, the Model, and Derivatives of the Model.
I really really enjoy seeing perpetual irrevocable licenses.
It's nice to see this when every other ToS we click through says the reverse..
"By using this service, you grant Meta/Google/Microsoft a perpetual, royalty free right to reprint, reproduce and use your content".
their code models are extremely good so I have high hopes for these.
Seems I am doing something wrong with this one.
I got abismal results with 4_K_M: it had silly grammatical errors and typos, it also did not stick to prompt, so I don't know.
I don't know if this helps but I'm using the GGUF version of that and it's working perfectly
Just find that this is released by high-flyer quant, one of the largest private equity firm in China.
The chat model is the first that knows how to compare the weight of bricks and feathers.
The weight of an object is determined by its mass and the gravitational force acting on it. In this case, both objects are being compared under the same gravitational conditions (assuming they're both on Earth), so we can compare their masses directly to determine which weighs more.
1kg of bricks has a mass of 1 kilogram. 2kg of feathers has a mass of 2 kilograms.
Since 2 is greater than 1, the 2kg of feathers weigh more than the 1kg of bricks.
That coding is pretty damn good based off of limited tests. I'll have to experiment more.
I asked it to create a simple chat interface to talk with open ai's gpt 3.5 api and to use stream = true option. On the first try, it didn't know how to handle the stream, so it simply used res.json(). After that, I told it that we needed to take care of streaming text in a special way. It understood this and wrote the correct code. Overall, I'm quite impressed. Way to go deepseak coder!