If i didnt missunderstood your question, answer is Petals:
https://research.yandex.com/blog/petals-decentralized-inference-and-finetuning-of-large-language-models
What is TGI?
If i didnt missunderstood your question, answer is Petals:
https://research.yandex.com/blog/petals-decentralized-inference-and-finetuning-of-large-language-models