this post was submitted on 23 Nov 2023
1 points (100.0% liked)

Machine Learning

1 readers
1 users here now

Community Rules:

founded 1 year ago
MODERATORS
 

I had an interview question regarding LLM. How exaclty do you deploy LLM, what are your consideration in terms of speed, resource, imbalance load, and all that stuff?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] milkteaoppa@alien.top 1 points 11 months ago (1 children)

Call the API using requests.post(..)