FlowmageDocs

Remove duplicates

Removes duplicate rows, on the fields you choose or on the whole row.

Settings

SettingWhat it is
RowsThe list to clean up.
FieldsRows that share these values become one. No fields removes exact duplicates instead.
Technical details
KeyValue
rowsany JSONits `{{ }}` must give an array
fieldslist of {field: text}, by default []

Output

FieldType
rowsarray
countRow countnumber
removedDuplicates removednumber
Sample output, and the expression for each field
  • count1
  • removed2
  • rows
    • [0]
      • id"INV-001"

Errors

When a step of this node stops a run, the run page shows a code. Look it up:

Example step

The step as a flow file holds it. Replace each value in <…>.

{
  "config": {
    "fields": [],
    "rows": "<rows>"
  },
  "label": "Remove duplicates",
  "type": "list.dedupe",
  "version": 1
}