Hello, I have a question about JSON to put in ElasticSearch
Hello, I’m a beginner in the knime tool and new here on the forum and I currently have a question about how to ingest data into elasticsearch.
The initial structure looks like this:
It consists of extracting data from the SQL Server database. I then read the data and then convert it from table to JSON. I then try to use String Manipulation to format them into Bulk format so that Elasticsearch will accept them. Next, I use the ElasticSearch Bulk Load node. Currently, only the ‘Index’ is being sent, but the data is not being included. I will leave here the configuration of each step of the workflow.
But the idea is to let this flow update automatically within Elasticsearch without repeating any records.
I’ll leave you with each configuration
“DB Query Reader”:
“Table to JSON”
“String Manipulation”
“ElasticSearch Bulk Load”
The structure at the moment is this, and with that it is only creating the “Index” without the data.
Could anyone help me with this?