Chunk Loop by Grouped Column values
Hello,
I am working on a workflow that is generating multiple output files for an ETL process.
For my example the output cannot exceed 5 rows of data per file, but we also want to minimize the number of outputs as the real data I am working with contains thousands of rows. The output cannot split rows on the ID or Record column, or the system will return a duplicate record error, and the process will fail.
My workflow was previously using a Chunk Loop Start node and setting my row limit as my rows per chunk value. How could I accomplish the example below in Knime using a loop?
Example data:
| ID | Record | Dollars |
| 1 | A | 5 |
| 1 | A | 15 |
| 2 | AB | 15 |
| 2 | AB | 18 |
| 3 | AC | 30 |
| 3 | AC | 15 |Example Outputs:
Output 1
| ID | Record | Dollars |
| 1 | A | 5 |
| 1 | A | 15 |
| 2 | AB | 15 |
| 2 | AB | 18 |Output 2
| ID | Record | Dollars |
| 3 | AC | 30 |
| 3 | AC | 15 |