LLMZip achieves SOTA compression by a large margin.
this post was submitted on 30 Oct 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
Very interesting π€ On what kind of data the compression is performing? Any progress in informational videos? I am working on building a smart media format too
The original LLMZip paper mainly focused on text compression. A later work (I forget the name) used an LLM trained on byte tokens. This allowed it to compress not just text, but any file format. I think it may have been Google who published that particular paper⦠Very impressive though.
I'm unclear on your definition of "top" but
- https://github.com/oobabooga/text-generation-webui - Popular open source llm frontend for just basic model usage.
- https://github.com/ggerganov/llama.cpp - Popular llm backend (See: gguf file format.)
- https://github.com/eth-sri/lmql - Best system for structured model outputs.
There's also AutoGen, it's quite popular on GitHub with almost 15k stars: https://github.com/microsoft/autogen
It's kinda similar to AutoGPT and it can also be used to generate code, like MetaGPT. I haven't really tried it so I can't say how good it is.
The code generation is kind of a toy. It requires fairly specific outputs without even really doing that much to try and guide the outputs well. Cool, but very prototypy at best.
vLLM, TGI, Tensort-LLM
Fuyu-8b
mlc llm(deploying llms on mobiles and in browsers)
https://github.com/bionic-gpt/bionic-gpt
β
allows you to run a full LLM stack with RAG on your PC and also deploy to the cloud as the whole thing is dockerised
A no code, Gen AI solution with RAG
I'm in spaaaaace!
You might want to check out the guidance DSL. It is conceptually similar to lmql but works on a lower level than lmql.
https://github.com/guidance-ai/guidance/
The library used to be developed by Microsoft. It seems like they spun it of as a independent company or nonprofit a few months ago.
RemindMe! 2 weeks
I keep an up-to-date list of code generation and Copilot-like tools here: https://github.com/ErikBjare/are-copilots-local-yet