Writing big files via Excel Reader

Version used: KNIME 5.8.1

I have a workflow which aggregates data on a monthly basis. The output is written via Excel Writer and therefore the output is growing with each monthly update.

One of the outputs is one Excel Writer which currently is at +40mb. Since the last monthly update, my workflow/KNIME crashes while writing the output.

I have tried the following already:

  • Adding a Chunk Loop where every 30,000 rows are written → it crashed

  • Increasing the Java Heap Space to 4GB

  • Take out redundant columns and rows to minimize the output —> Error: “Java Heap Space”

Nothing has helped so far. I have a similar WF in Alteryx and there writing the export works just fine.

[Pushing the output into a database would be a solution, but the objective is to have an Excel file]

Any other suggestions?