Filter rows
The Filter step allows you to selectively include or exclude rows from your dataset based on specified conditions. This step is part of a data processing pipeline and can be used to modify data coming from datasets represented in rows and columns.
Step parameters
Condition: This is where you define your filtering criteria. You can create three types of conditions:
Simple condition*:
Column
(string)*: Enter the name of the column you want to filter on.Operator
[operators]*: Choose an operator to filter your data. defaults toeq
Value
*: Enter the value to compare against (not required forisnull
andnotnull
operators).
ADD CONDITION : Combine multiple simple conditions that you can bind by either an "AND" or "OR" logical operator
ADD GROUP (): Add a group of simple conditions that you can bind by either an "AND" or "OR" logical operator. Note that you cannot nest a group of conditions in another group.
Example
Input

Configuration
{
"condition": {
"OR": [
{
"column": "department",
"value": "IT",
"operator": "eq"
},
{
"column": "country",
"value": "Canada",
"operator": "eq"
}
]
}
Output

Last updated
Was this helpful?