Page History
The data transformation module is used to perform various types of transformations on Data Transformation module offers different ways of performing transformations on your data. These include transformation steps that can be dragged into a flow, performing inline field transformations, and even data conversion. Besides the transformation steps that come included with this module, you can also download and install plug-ins to include more steps in your environment.
can be done via transformation steps or by carrying out functions directly on the data. Here is a breakdown of the different ways of performing transformations:
- Built-in transformations: This refers to transformations in the transformation step panel that come included in the data transformation module. These do not require any type of set up.
- Downloadable transformation step: Users You can also download and install special plug-ins from the Marketplace that become available in the transformation step panel. (See the Transform Steps section in the Marketplace for all available options.)
- Inline field Field transformations: This refers to functions that users can perform directly on the data (in the data preview panel or the configure step configuration panel).
Following is a list of all the transformations that you can perform on your data. Click on a transformation name to learn how to use it in your flow.
Transformation | Type | Description | ||||||
---|---|---|---|---|---|---|---|---|
Built-in transformation step | This step transforms your data into a summary form, by applying functions like count, count distinct, sum, average, etc. | |||||||
Built-in transformation step | This step creates a calculated field based on other fields in the step. | |||||||
Built-in transformation step | This step is for filtering data in a step. | |||||||
Built-in transformation step | This step merges two sets of data based on the configured Join Fields. | |||||||
Built-in transformation step | This step duplicates an input dataset to create identical output datasets. | |||||||
Union | Built-in transformation step | This step combines the data from two steps together. | ||||||
Date Component | Built-in transformation step | This step extracts specific date elements from date fields. | ||||||
PitneyBowes Forward Geocoding | Downloadable transformation step | This step uses the PitneyBowes forward geocoding API to convert address values into location coordinates. | ||||||
OpenCage Forward Geocoding | Downloadable transformation step | Uses the OpenCage forward geocoding API to convert address values into location coordinates. | ||||||
PMML Model Prediction | Downloadable transformation step | This step integrates a model saved as a PMML model file into the platform and applies it on the data. | ||||||
PFA Model Prediction | Downloadable transformation step | This step integrates a PFA model and applies it on the data. | ||||||
H2O Model Prediction | Downloadable transformation step | This step integrates a model created in H2O model .ai and applies it on the data. | ||||||
R Model Prediction | Downloadable transformation step | This step integrates a an R model and applies it on the data. | ||||||
Datatype Data Type Conversions | Inline Field transformation | This function is Set of functions used to convert the datatype data type of a field into another type. For example, text can be converted into numeric values, SQL date, or SQL timestamp. | ||||||
GeoPoint Conversion | Data type conversion | Generate GeoPoint values based on geographical data. | ||||||
Duplicate Field |
| To create Create a copy of the data field. | ||||||
Number Precision | Inline Field transformation | To round Round off a numeric value. | ||||||
Sub-string | Inline Field transformation | To extract Extract part of a string. | ||||||
Switch Case | Inline Field transformation | To convert Convert text to all uppercase, all lowercase, or proper case. | ||||||
White Space | Inline Field transformation | To remove Remove white space from data. | ||||||
Find and Replace | Inline Field transformation | Search for specific data values and replace them with other values. | ||||||
Grouped Data | Inline Field transformation | Group a field's values. | ||||||
Nulls to Zero | Inline Field transformation | Replaces every null value in a numeric field with zero. |