Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 11 months ago

MODERATORS

communick@academy.garden

[D] Is LLM the way to extract out certain text from a longer text? (alien.top)

submitted 10 months ago by plsendfast@alien.top to c/machinelearning@academy.garden

2 comments fedilink hide all child comments

Hi everyone, just thought I can write a post here to bounce ideas off.

I have multiple clauses, and I want to extract out the object of interest within that clause. For example, this is a clause: " Exit staircases shall be constructed of non-combustible materials to comply with the provisions of Cl.3.10.1.". Obviously, the object of interest here is 'exit staircases' or 'staircases', so I want that to be extracted. Here is another clause: "No structure or building shall be constructed within a sewer.". Now, there are multiple object in that clause (i.e structure, building, and sewer), but it is also obvious that the object of interest is referring to 'sewer'.

I ran through this in GPT-3.5, and it works. The GPT is able to return me the object of interest pretty accurately. However, is it possible to mass generate the response from GPT based on my huge list of clauses, instead of inputting the prompt very often? How do I do that? For example, I have a list of clauses, how can I make use of LLM such that I can get back the object of interest of each particular clause without prompting it manually?

Also, is this the correct/ideal way to extract out the object of interest for a huge list of clauses? My final goal is to cluster those similar object of interest, and see what clauses those object of interest are linked to (via some kind of RAG approach). So I create some kind of knowledge graph from that. Do you think my method is the right approach?

Thanks!

you are viewing a single comment's thread
view the rest of the comments

[–] fvillena@alien.top 1 points 10 months ago

We are developing a library for this exact use case. https://github.com/plncmm/llmner

Your task is called Named Entity Recognition and llmNER is a library that uses the llm of your choice to extract entities from texts given a natural language description.

You can give the model a list of strings where to extract the entities and the modem will return a list of annotated strings for you to extract the information you need.

Be aware that our library is under active development right now.