The Data Transformation module offers different ways of performing transformations on your data. These include transformation steps, performing inline field transformations, and even data conversion. Besides the transformation steps that come included with this module, you can also download and install plug-ins to include more steps in your environment.
Here is a breakdown of the different ways of performing transformations:
- Built-in transformations: This refers to transformations in the transformation step panel that come included in the data transformation module. These do not require any type of set up.
- Downloadable transformation step: You can also download and install special plug-ins from the Marketplace that become available in the transformation step panel. (See the Transform Steps section in the Marketplace for all available options.)
- Inline field transformations: This refers to functions that users can perform directly on the data (in the data preview panel or the step configuration panel).
Following is a list of all the transformations that you can perform on your data. Click on a transformation name to learn how to use it in your flow.
Transformation | Type | Description |
---|---|---|
Built-in transformation step | This step transforms your data into a summary form, by applying functions like count, count distinct, sum, average, etc. | |
Built-in transformation step | This step creates a calculated field based on other fields in the step. | |
Built-in transformation step | This step is for filtering data in a step. | |
Built-in transformation step | This step merges two sets of data based on the configured Join Fields. | |
Built-in transformation step | This step duplicates an input dataset to create identical output datasets. | |
PMML Model Prediction | Downloadable transformation step | This step integrates a model saved as a PMML file into the platform and applies it on the data. |
PFA Model Prediction | Downloadable transformation step | This step integrates a PFA model and applies it on the data. |
H2O Model Prediction | Downloadable transformation step | This step integrates a model created in H2O.ai and applies it on the data. |
R Model Prediction | Downloadable transformation step | This step integrates an R model and applies it on the data. |
Datatype Conversions | Inline Field transformation | This function is used to convert the datatype of a field into another type. For example, text can be converted into numeric values, SQL date, or SQL timestamp. |
Duplicate Field | Inline Field transformation | To create a copy of the data field. |
Number Precision | Inline Field transformation | To round off a numeric value. |
Sub-string | Inline Field transformation | To extract part of a string. |
Switch Case | Inline Field transformation | To convert text to all uppercase, all lowercase, or proper case. |
White Space | Inline Field transformation | To remove white space from data. |