I have been using the Python API client 1.0 preview version (which was just released) for some time with vLLM OpenAI compatible server and it worked well -- at least I did not notice any issues.
DreamGenX
joined 1 year ago
There was a bug on the website where the first time the "Continue" would not work if you did not refresh, should work now even though the editor is quite janky still, sorry for that :(
(can't wait for AI to take over React from me :P)
Great news, the great /u/TheBloke is working on this!
https://preview.redd.it/uqebzbr1q8zb1.png?width=2175&format=png&auto=webp&s=46ab334fa4b2b3cabab7d36461f991edfd2e8a60