AI + Vector store: Chat with your data?

Hello .

I’m playing around with the AI nodes and vector store and already worked through some documentation, articles and examples. My goal is to talk with my data a little bit. As far as I can see, all examples are following this logic:

1. Define question

2. Ask the vector store

3. Create an augumented prompt

1.

LLM Prompter

As long as the question is very specific and the data is accurate, this works in most cases. For very generic questions on a dataset with ~10k entries, I want to have the process structured in another way, as it struggles with the results from the vector store. Why? Because the data in the VS doesn’t match to the questions directly but still it is there.

My ideal process would look like:

1. Define question

2. LLM Prompter

3. LLM looks up the VS for additional data

4. Answer to the question including the enriched data

Example to make it clearer: The data contains information about let’s say 10k different hammers. The question is “how to drive a nail into a wall?”. The response w/o the data would be “Take a hammer”, the result with the data shall be “Take hammer AB5000, it fits best for this job”.

Did I make a mistake in my way of thinking or do I have to check for another process or logic, e.g. the new “Agentic AI” tools?