70k32

joined 7 months ago
[–] 70k32@sh.itjust.works 1 points 1 day ago

This. Llama.cpp with Vulkan backend running in docker-compose, some Qwen3-Coder quantization from huggingface and pointing Opencode to that local setup with a OpenAI-compatible is working great for me.