this post was submitted on 24 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
What model to “transcribe notes”? (alien.top)
submitted 11 months ago by olddoglearnsnewtrick@alien.top to c/localllama@poweruser.forum
5 comments fedilink hide all child comments
 

I have a large corpus of notes humans wrote to summarize articles. As is they will give you the gist but are not very readable. I would like to use a gen model and ask “please write a short sentence that will be nice to read describing the following facts” and feed it the notes, to obtain a brief readable summary.

Language is Italian.

Suggestions on models or workflows?

Thanks

you are viewing a single comment's thread
view the rest of the comments
[–] Kimononono@alien.top 1 points 11 months ago

  1. you’d probably want to embed the notes and then use cosine similarity to find similar notes given your input query (“please write a short sentence describing the following facts…”, use the facts in the cosine similarity search ).

  2. Then pass the similar notes into a llm with a instruction like “please write a short sentence describing the following facts using the notes”

I don’t know how well embeddings work for italian so you may want to translate them to english and keep them in pairs (italian version, english version) then use the english for the cosine similarity search ( step 1. ) and the italian version for the summarization ( step 2. )