Transformation flows are created by combining various steps through connectors. Use the information below to learn more about these steps and connectors.
Input Steps
Include an input step to define where to extract your data from. The following types can be used:
Icon | Input source | Description |
File | This input method is used when extracting data from a file with a .csv extension. | |
Freehand SQL | Use this method to import data from a database using an SQL query. | |
Report | Use this method to use a Yellowfin report as the source of data. | |
Database table | This input step can be used to import data from a single database table. | |
Third party connector | To extract data from a third-party connector, such as Twitter, Facebook, Google Analytics, etc. |
Transformation Steps
Use a transformation step to transform or convert the connected data.
Icon | Transformation type | Description |
---|---|---|
| Aggregate Step | This step summarises data including the ability to count, sum and average metric fields. |
Calculated Field | This step creates a calculated field based on other fields in the step. | |
Filter | This step is for filtering data in a step. | |
Merge | This step merges two sets of data based on the configured Join Fields. | |
Split | This step duplicates an input dataset to create identical output datasets. |
Output Steps
Save the transformed data into a database using an output step.
Icon | Transformation type | Description |
---|---|---|
SQL Database
| This outputs data to a selected writeable data source. There are multiple options to create and manage tables and indexes, and to insert or update data. |
Connectors
Connectors are used to join steps together and create a relationship between them. Data will flow from one step to another step. Click on a step to reveal its connecting points. These points are then used to connect one step to another. The flow of a connector is represented with an arrowhead at the end of it.
Connection rules
These rules are applicable on step connecors (running left to right).
- An input step can be connected to only one transformation or output step.
- A transformation step cannot be connected to an input step, but to another transformation or output step.
- All types of transformation steps, except the split step, can only be connected to one other step.
- A split step can be connected multiple times.
- Connections can only be made to an output step, but it cannot be the origin of a connection.
Breaking a Connection
Once a connection is created between two steps, it can be broken or deleted. Simply right-click on one of the steps, and click on Break Connections. This will break all the connections associated with that step.
Alternatively right-click on the connector itself and select Break Connections.
Step Functions
Once a step is added to the canvas, right-click on it to see the functions that can be performed on it.
These are explained below:
Function | Description |
---|---|
Copy | To create a copy of the step. |
Break Connections | To break any connections that the steps has with other steps. |
Delete | To delete the step. |