LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

LocalLLaMA and translate texts (alien.top)

submitted 9 months ago by MajesticFigure4240@alien.top to c/localllama@poweruser.forum

6 comments fedilink hide all child comments

GPT4 does quite well with text translation. Unfortunately, the free version, it has limits on the input/translated text.

(Google translator and DeepL translate worse)

Is there any ranking available somewhere of Local LLMs ALE used to translate texts into other languages?

What FREE language models are available with a window context limit of at least 64k tokens or more (only such are suitable for text translation)?

Unless there is some way to somehow automatically split a long text into chunks and send them to the LLM for translation.

you are viewing a single comment's thread
view the rest of the comments

[–] Chaosdrifer@alien.top 1 points 9 months ago

You can try something like Claude.ai which has long context and is free to use.

You can use a python script to load the model, split the text into chunks, and ask the model to translate per chunk, then you don't need a model with 64K context window (which will take up a lot of memory and are not that common).

It also depends on the language you are trying to translate, it would be best to find models that has been trained in the original language, most models have a large english corpus, with many finetuned with chinese data, but there are specialty models for German/arabic/japanese, try google search or find on hugging face.