Issue
The execution of the Filter step takes a very long time.
Cause
When the data frame is grouped, and there are a large number of groups, the execution of the Filter step can become slow.
Solution
- Move the Filter step before the Group step
- Applying filtering before grouping reduces the amount of data to process, improving execution speed.
- Ungroup data before the Filter step
- Temporarily ungrouping the data allows the Filter step to execute faster.
- In Exploratory, add an “Ungroup” step right before the Filter step to resolve the issue.
By following these approaches, the execution time of the Filter step can be significantly improved.