nullnuller

joined 1 year ago
sorted by: new top controversial old
Having a hard time setting deepseek coder instruct to work in c/localllama@poweruser.forum
[–] nullnuller@alien.top 1 points 1 year ago (1 children)

Do you just copy and paste the terminal output containing \n and whitepspaces in the .\main output to VSCode or similar IDE and it works?

Having a hard time setting deepseek coder instruct to work in c/localllama@poweruser.forum
[–] nullnuller@alien.top 1 points 1 year ago

I tried 0.28 and it only shows newlines in the server logs and nothing at all in the UI

Got Llama.cpp WebUI to work on Colab in c/localllama@poweruser.forum
[–] nullnuller@alien.top 1 points 1 year ago

Great work. It would be nice to have some caching and automatically detecting and re-running the Colab session, as others have pointed out.