nullnuller

joined 10 months ago
sorted by: new top controversial old
Having a hard time setting deepseek coder instruct to work in c/localllama@poweruser.forum
[–] nullnuller@alien.top 1 points 10 months ago (1 children)

Do you just copy and paste the terminal output containing \n and whitepspaces in the .\main output to VSCode or similar IDE and it works?

Having a hard time setting deepseek coder instruct to work in c/localllama@poweruser.forum
[–] nullnuller@alien.top 1 points 10 months ago

I tried 0.28 and it only shows newlines in the server logs and nothing at all in the UI

Got Llama.cpp WebUI to work on Colab in c/localllama@poweruser.forum
[–] nullnuller@alien.top 1 points 10 months ago

Great work. It would be nice to have some caching and automatically detecting and re-running the Colab session, as others have pointed out.