this post was submitted on 01 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Why are you running local models? What are you doing with them? (alien.top)
submitted 1 year ago by ExtremelyQualified@alien.top to c/localllama@poweruser.forum
28 comments fedilink hide all child comments
 

I’m fascinated by the whole ecosystem popping up around llama and local LLMs. I’m also curious what everyone here is up to with the models they are running.

Why are you interested in running local models? What are you doing with them?

Secondarily, how are you running your models? Are you truly running them on a local hardware or on a cloud service?

you are viewing a single comment's thread
view the rest of the comments
[–] softwareweaver@alien.top 1 points 1 year ago

We are using Local Models to power Fusion Quill's AI Word Processor. Fusion Quill is a Windows App on the Microsoft Store.

We are currently using the Mistral 7B model to do various tasks like Summarization, Expand Content, etc. See our YouTube Video
https://youtu.be/883IoDlRzpM

We expect Local AI models to continue to evolve but we also support Open AI's Chat GPT API and vLLM APIs.

Regards,
Ash
FusionQuill.AI