this post was submitted on 04 Dec 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
which is the best model (finetuned or base) to extract structured data from a bunch of text? (alien.top)
submitted 11 months ago by sandys1@alien.top to c/localllama@poweruser.forum
6 comments fedilink hide all child comments
 

hi folks,

simple question really - what model (finetuned or otherwise) have you found that can extract data from a bunch of text.

I'm happy to finetune, so if there are any successes there, would really appreciate some pointers in the right direction.

Really looking for a starting point here. I'm aware of the DETR class of models and how Microsoft trained table-transformers on DETR. Wondering if that can be done on llama2,etc models ?

P.S. cannot use GPT because of sensitive PII data.

you are viewing a single comment's thread
view the rest of the comments
[–] Iamisseibelial@alien.top 1 points 11 months ago

Ohh that's absolutely fair, especially when dealing with Singapore, SK or Japan. APPI AND PIPA are a pain in the ass to deal with. That said making fake versions of the data for examples is likely the best route to actually be able to train your own model then.