this post was submitted on 27 Nov 2023
1 points (100.0% liked)

LocalLLaMA

4 readers
4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago
MODERATORS
communick@poweruser.forum
1
LLaMA 2 7b exclusively for summarization (alien.top)
submitted 2 years ago by iamtdb@alien.top to c/localllama@poweruser.forum
0 comments fedilink hide all child comments
 

Hi all,

I am running a LLaMA 2 7b model on a AWS Sagemaker instance. I need the model just for providing me summaries of long documents, and i am using Langchain to do a map reduce on the data and get a summary of it.

I want to know if there's a better way to do this or if you could share your personal experiences on summarizing efficiently.

I am not getting good results since the summarization includes too much information.

Thanks in advance.

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here