Issue getting local Llama model to work with workflow.

I download the Use LLama3 as Local Model to perform sentiment analysis on Customer Review to test it out.

To test that the workflow works well, i replaced the nodes to open ai nodes before the LLM prompter note to test out the workflow and i can see that i received a response after running the workflow. Refer to video recording: KNIME Analytics Platform - 12 August 2024 | Loom

However, after i replace the ai nodes with the LocalGPT4All Chat model connector and loaded my local LLama3 model, i noted that the output is “”. Instead of what i received when my open ai nodes were connected. Refer to video recording: KNIME Analytics Platform - 12 August 2024 | Loom

I would like to ask if the issue of “” output is it due to (1)the wrong LLama3 model i downloaded? (2) or the wrong configuration settings in my LocalGPT4All Chat model connector? (3) or simply the LLama3 model 8B is simply not good enough to process this workflow?

My “LocalGPT4All Chat model connector” can be seen in the video recording.

For my Meta-Llama-3.1-8B-Instruct-Q4KM.gguf, i downloaded it using LM Studio.

Additionally, i like to ask is there any knime connector that allows me to call my local LLM model such as the Meta-Llama-3.1-405B stored on a centralised server via API within my network without going out to the internet. Or can i store it in a file share so everyone of my team can access this model on a shared drive (not sure if its an efficient way as the model is so big).

I would like to explore using the most advance local LLM model but stored centrally so every member running knime can call it. Looking for the best solution to this.