a_slay_nub

joined 2 years ago
sorted by: new top controversial old
Qwen-72B released in c/localllama@poweruser.forum
[–] a_slay_nub@alien.top 1 points 2 years ago (1 children)

Bit disappointed by the coding performance but it is a general use case model. It's insane how good gpt 3.5 is for how fast it is.

is there any other tools like vLLM or TensorRT that can be used to speed up LLM inference? in c/localllama@poweruser.forum
[–] a_slay_nub@alien.top 1 points 2 years ago

Lmdeploy is another one

FACT SHEET: President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence | The White House in c/localllama@poweruser.forum
[–] a_slay_nub@alien.top 1 points 2 years ago (6 children)

Care to elaborate on what the actual reality of this EO is?

1
FACT SHEET: President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence | The White House (www.whitehouse.gov)