The Data Transformation module offers different ways of performing transformations on your data. These include transformation steps that can be dragged into a flow, performing inline field transformations, and even data conversion. Besides the transformation steps that come included with this module, you can also download and install plug-ins to include more steps in your environment.
Here is a breakdown of the different ways of performing transformations:
Following is a list of all the transformations that you can perform on your data. Click on a transformation name to learn how to use it in your flow.
Transformation | Type | Description |
---|---|---|
Built-in transformation step | This step transforms your data into a summary form, by applying functions like count, count distinct, sum, average, etc. | |
Built-in transformation step | This step creates a calculated field based on other fields in the step. | |
Built-in transformation step | This step is for filtering data in a step. | |
Built-in transformation step | This step merges two sets of data based on the configured Join Fields. | |
Built-in transformation step | This step duplicates an input dataset to create identical output datasets. | |
Union | Built-in transformation step | This step combines the data from two steps together. |
Date Component | Built-in transformation step | This step extracts specific date elements from date fields. |
PitneyBowes Forward Geocoding | Downloadable transformation step | This step uses the PitneyBowes forward geocoding API to convert address values into location coordinates. |
OpenCage Forward Geocoding | Downloadable transformation step | Uses the OpenCage forward geocoding API to convert address values into location coordinates. |
PMML Model Prediction | Downloadable transformation step | This step integrates a model saved as a PMML file into the platform and applies it on the data. |
PFA Model Prediction | Downloadable transformation step | This step integrates a PFA model and applies it on the data. |
H2O Model Prediction | Downloadable transformation step | This step integrates a model created in H2O.ai and applies it on the data. |
R Model Prediction | Downloadable transformation step | This step integrates an R model and applies it on the data. |
Data Type Conversions | Inline Field transformation | Set of functions used to convert the data type of a field into another type. For example, text can be converted into numeric values, SQL date, or SQL timestamp. |
GeoPoint Conversion | Data type conversion | Generate GeoPoint values based on geographical data. |
Duplicate Field | Create a copy of the data field. | |
Number Precision | Inline Field transformation | Round off a numeric value. |
Sub-string | Inline Field transformation | Extract part of a string. |
Switch Case | Inline Field transformation | Convert text to all uppercase, all lowercase, or proper case. |
White Space | Inline Field transformation | Remove white space from data. |
Find and Replace | Inline Field transformation | Search for specific data values and replace them with other values. |
Grouped Data | Inline Field transformation | Group a field's values. |
Nulls to Zero | Inline Field transformation | Replaces every null value in a numeric field with zero. |