I get a different Error: "guidance\library\_select.py", line 121, in recursive_select for k,v in logprobs_result["top_logprobs"][0].items(): TypeError: 'NoneType' object is not subscriptable Error in program: 'NoneType' object is not subscriptable"
LM Studio sent a response " "text": "there is no safety,\nbut with many advisers there is success.", "logprobs": null, "
I guess the "logprobs" are the Problem here. (I have no Idea what I'm doing, TBH).
I modified only Line 4 of the Example to : guidance.llm = guidance.llms.OpenAI("text-davinci-003", api_key = "foobar", api_base = "http://localhost:1234/v1")
I get a different Error: "guidance\library\_select.py", line 121, in recursive_select for k,v in logprobs_result["top_logprobs"][0].items(): TypeError: 'NoneType' object is not subscriptable Error in program: 'NoneType' object is not subscriptable"
LM Studio sent a response " "text": "there is no safety,\nbut with many advisers there is success.", "logprobs": null, "
I guess the "logprobs" are the Problem here. (I have no Idea what I'm doing, TBH).
I modified only Line 4 of the Example to :
guidance.llm = guidance.llms.OpenAI("text-davinci-003", api_key = "foobar", api_base = "http://localhost:1234/v1")