Page History
Overview
This section provides detailed procedures on the different types of data transformations you could perform.
You can transform your data using the pre-built transformation steps, or by through certain functions in the data preview panel. Transformation widgets for data science models are also available in Yellowfin's Marketplace, that allows users to integrate data models, such as PMML, PFA, R and H2O, into their platforms and apply them on their data.
The Data Transformation module offers different ways of performing transformations on your data. These include transformation steps that can be dragged into a flow, performing inline field transformations, and even data conversion. Besides the transformation steps that come included with this module, you can also download and install plug-ins to include more steps in your environment.
Here is a breakdown of the different ways of performing transformations:
- Built-in transformations: This refers to transformations in the transformation step panel that come included in the data transformation module. These do not require any type of set up.
- Downloadable transformation step: You can also download and install special plug-ins from the Marketplace that become available in the transformation step panel. (See the Transform Steps section in the Marketplace for all available options.)
- Inline field transformations: This refers to functions that users can perform directly on the data (in the data preview panel or the step configuration panel).
Following is a list of all the transformations that you can perform on your data. Click on a transformation name to learn how to use it in your flow.
Transformation | Type | Description | ||||||
---|---|---|---|---|---|---|---|---|
Built-in | ||||||||
Icon | Transformation | Related Component | Description | |||||
Aggregate | Pre-built transformation step | This step transforms your data into a summary form, by applying functions like count, count distinct, sum, average, etc. | ||||||
Built-in transformation step | This step creates a calculated field based on other fields in the step. | |||||||
Built-in transformation step | This step is for filtering data in a step. | |||||||
Built-in transformation step | This step merges two sets of data based on the configured Join Fields. | |||||||
Built-in transformation step | This step duplicates an input dataset to create identical output datasets.. | |||||||
Union | Built-in transformation step | This step combines the data from two steps together. | ||||||
Date Component | Built-in transformation step | This step extracts specific date elements from date fields. | ||||||
PitneyBowes Forward Geocoding | Downloadable transformation step | This step uses the PitneyBowes forward geocoding API to convert address values into location coordinates. | ||||||
OpenCage Forward Geocoding | Downloadable transformation step | Uses the OpenCage forward geocoding API to convert address values into location coordinates. | ||||||
PMML Model Prediction | Downloadable transformation step | This step integrates a model saved as a PMML file into the platform and applies it on the data. | ||||||
PFA Model Prediction | Downloadable transformation step | This step integrates a PFA model and applies it on the data. | ||||||
H2O Model Prediction | ||||||||
R Model Prediction | ||||||||
Duplicate Field | Field transformation | |||||||
Number Precision | ||||||||
Sub-string | ||||||||
Switch Case | ||||||||
Downloadable transformation step | This step integrates a model created in H2O.ai and applies it on the data. | |||||||
R Model Prediction | Downloadable transformation step | This step integrates an R model and applies it on the data. | ||||||
Data Type Conversions | Inline Field transformation | Set of functions used to convert the data type of a field into another type. For example, text can be converted into numeric values, SQL date, or SQL timestamp. | ||||||
GeoPoint Conversion | Data type conversion | Generate GeoPoint values based on geographical data. | ||||||
Duplicate Field |
| Create a copy of the data field. | ||||||
Number Precision | Inline Field transformation | Round off a numeric value. | ||||||
Sub-string | Inline Field transformation | Extract part of a string. | ||||||
Switch Case | Inline Field transformation | Convert text to all uppercase, all lowercase, or proper case. | ||||||
White Space | Inline Field transformation | Remove white space from data. | ||||||
Find and Replace | Inline Field transformation | Search for specific data values and replace them with other values. | ||||||
Grouped Data | Inline Field transformation | Group a field's values. | ||||||
Nulls to Zero | Inline Field transformation | Replaces every null value in a numeric field with zero. | White Space |