a_slay_nub

joined 10 months ago
sorted by: new top controversial old
Qwen-72B released in c/localllama@poweruser.forum
[–] a_slay_nub@alien.top 1 points 9 months ago (1 children)

Bit disappointed by the coding performance but it is a general use case model. It's insane how good gpt 3.5 is for how fast it is.

is there any other tools like vLLM or TensorRT that can be used to speed up LLM inference? in c/localllama@poweruser.forum
[–] a_slay_nub@alien.top 1 points 10 months ago

Lmdeploy is another one

FACT SHEET: President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence | The White House in c/localllama@poweruser.forum
[–] a_slay_nub@alien.top 1 points 10 months ago (6 children)

Care to elaborate on what the actual reality of this EO is?

1
FACT SHEET: President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence | The White House (www.whitehouse.gov)