LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

submitted 1 year ago by decruz007@alien.top to c/localllama@poweruser.forum

15 comments fedilink hide all child comments

Use case is that I want to create a service based on Mistral 7b that will server an internal office of 8-10 users.

I’ve been looking at modal.com, and runpod. Are there any other recommendations?

you are viewing a single comment's thread
view the rest of the comments

[–] clxyder@alien.top 1 points 1 year ago (1 children)

Do you have hardware to serve the API or do you want to run this from the cloud?

[–] decruz007@alien.top 1 points 1 year ago

Looking at cloud as an option. Don’t really have hardware now.