I've been meaning to create a 32B local model of code-llama2 to help me with coding questions mostly. Sort of a personal KB (phind-33B, if you have better suggestions please let me know).
I thought of using langchain + code-llama2 + chromadb. I did read around that this could be a good setup.
A question though: I mostly have long markdown documents in the form of Q&A that I can RAG later
```
question: how do you write a fibonacci C++ function recursive?
answer: here's how:
```cpp
blabla
````
```
-> would it make sense to use chromadb for that? I guess I could do better than just automatically splitting paragraphs but even indicate where one Q&A starts and where one ends, not sure if I could use chromadb or another DB with some sort of 'schema'. Thanks.