a_slay_nub

joined 1 year ago
sorted by: new top controversial old
Qwen-72B released in c/localllama@poweruser.forum
[–] a_slay_nub@alien.top 1 points 11 months ago (1 children)

Bit disappointed by the coding performance but it is a general use case model. It's insane how good gpt 3.5 is for how fast it is.

is there any other tools like vLLM or TensorRT that can be used to speed up LLM inference? in c/localllama@poweruser.forum
[–] a_slay_nub@alien.top 1 points 1 year ago

Lmdeploy is another one

FACT SHEET: President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence | The White House in c/localllama@poweruser.forum
[–] a_slay_nub@alien.top 1 points 1 year ago (6 children)

Care to elaborate on what the actual reality of this EO is?

1
FACT SHEET: President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence | The White House (www.whitehouse.gov)