FillNanWithNull / Manipulation Layer
Convert NaN (Not a Number) values to null in floating-point columns. Similar to pandas' isna() followed by fillna() or R's is.nan() replacement.
This operation specifically targets floating-point special values:
- NaN from invalid operations (0/0)
- NaN from undefined mathematical results (sqrt(-1))
- NaN propagated from previous calculations
Common applications:
- Data cleaning before analysis
- Standardizing missing value representation
- Preparing data for export/import
- Database compatibility
- Statistical software interoperability
Note: Only affects floating-point columns; other data types remain unchanged as they cannot contain NaN values.
Transforms
[, ...]Defines a single column transformation from NaN to null. This standardizes the representation of missing or invalid data, making it consistent with other missing value handling operations in the data processing pipeline.
SelectNan
columnThe floating-point column containing NaN values to convert. Common sources:
- Scientific calculations
- Sensor readings
- Financial computations
- Statistical operations Non-floating-point columns will be ignored.
AsColumn
nameName for the new column. If not provided, the system generates a unique name. If AsColumn
matches an existing column, the existing column is replaced. The name should follow valid column naming conventions.