Open AI connector - reopen of issue
Hi
Sorry to reopen a closed Thread - Open AI connector - sort off - info - #8 by mgirdwood
Now I have the new 5.4.2 installed on the works PC I have been able to revisit this issue. (AI nodes were broken for me in the last version )
Using part of the the workflow Using KNIME LLM Nodes for Text Generation and Chat based Information Retrieval (RAG) created by Tosinlitics to test the connection to my companies local LLM again I believe that the initial connections are ok based on Green as shown in the image. However when the data is fed into the Prompter this fails with the info in the txt file.
In our documenation for the API there is the need to have the “/v1/chat/completions” added to the end of the API key but I can not see if this actually part of the Chat Model Prompter Node or if it should be added as part of the URL in the Open AI authenticator or elsewhere (i tried but same errors)
As mentioned previously I know when we are using Alteryx we needed to call a Powershell script in the workflow due to a proxy issue and this may be the actual problem here but I am trying to check my way through from the start. If i run the local LLM in Chrome it of course works so I had hoped that Knime might use these settings in its proxy call.
Is there any way I can provide additional details here to help work through the topic ?
Thanks as always