LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Rag vs Vector db (alien.top)

submitted 1 year ago by troposfer@alien.top to c/localllama@poweruser.forum

9 comments fedilink hide all child comments

I am confused about these 2 . Sometimes people use it interchangeably. Is it because rag is a method and where u store it should be vector db ? I remember before llms there was word2vec in the beginning ,before all of this llm. But isn’t the hard part to create such a meaningful word2vec , by the way word2vec is now called “embeddings” right?

you are viewing a single comment's thread
view the rest of the comments

[–] Aebae7ee@alien.top 1 points 1 year ago

RAG, which stands for Retrieval-Augmented Generation, is a method that combines retrieval and generation models to improve the quality of natural language processing tasks such as text generation and question-answering. VectorDB is a specific database used for storing vectors, which are numerical representations of words or documents. These vectors are often used in conjunction with RAG models to enable efficient retrieval and generation of text.

It's not entirely accurate to use RAG and VectorDB interchangeably because RAG refers to the method or model, while VectorDB refers to the specific database used to store vectors. RAG can be implemented using various databases, not just VectorDB.

Word2vec is indeed an earlier method for generating word embeddings, which are numerical representations of words. Word embeddings, including those generated by Word2vec, are often used as a foundation for various natural language processing tasks. The term "embeddings" is used more broadly to refer to any type of numerical representation of words or documents, not just limited to Word2vec.

Creating meaningful word embeddings is indeed a challenging task, and it's an active area of research in natural language processing. The quality of word embeddings can significantly impact the performance of downstream NLP tasks, so there is ongoing effort to improve the methods for generating and using embeddings in models.

Source: gpt-3.5-turbo-1106 :-)