this post was submitted on 26 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
Colud LLaVa be finetuned to perform image to markdown or even image to html conversion? (alien.top)
submitted 9 months ago by tortistic_turtle@alien.top to c/localllama@poweruser.forum
3 comments fedilink hide all child comments
 

Hello! I am wondering, since this would be a very interesting use case and there is more than enough training material out there (pretty much every MD file could be rendered, then the image and markdown code could be used for training/finetuning)

however I have pretty much no idea about llava. Do you think this would be feasible to do?

you are viewing a single comment's thread
view the rest of the comments
[–] herozorro@alien.top 1 points 9 months ago

what you are looking for is OCR. then feed the LLM to the markdown