Like what you see? Have a play with our trial version.

Error rendering macro 'rw-search'

null

Versions Compared

Old Version 7

changes.mady.by.user Unknown User (admin)

Saved on

compared with

New Version 8

changes.mady.by.user Unknown User (admin)

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

#

Function/Panel

Description

1.

Navigation menu

The buttons here enable you to save, publish and delete a transformation flow.

2.

Steps

The different types of transformation steps can be selected from the buttons. There are three main types:

  • Input steps
  • Transformation steps
  • Output steps

These are connected to one another by connectors. 

3.

Middle header menu

  • Schedule: Configure a batch schedule for the transformation flow.
  • Transformation Summary: Provides details of the transformation flow.
  • Run: Use the run button to execute the data transformation flow. This button should be used for testing only as it will only transform the sample data included in the data preview panel (which has a maximum limit of 200).

4.

Configuration panel

Used to configure a selected step or the overall flow. The tabs in this panel will vary according to the selected step or main flow.

5.

Data preview panel

This shows the extracted and/or transformed data. Every time a change is made, it can instantly be viewed here.

6.

Transformation builder canvas

This canvas is used to create the transformation flow. Drag items here to include them in the flow.

7.

Canvas positioner

The map view can be used to move the canvas around - this is useful when there are large numbers of steps on the canvas. You can also use this to re-centre the canvas.

 

Steps

 

Expand
titleInput Steps

 

Include an input step to define where to extract your data from. The following types can be used:

Input Step Types

Section
Column

Image Removed

Column

Icon

Input source

Description

Image Removed

File

This input method is used when extracting data from a file with a .csv extension.

Image Removed

Freehand SQL

Use this method to import data from a database using an SQL query.

Image Removed

Report

Use this method to use a Yellowfin report as the source of data.

Image Removed

Database table

This input step can be used to import data from a single database table.

Image Removed

Third party connector

To extract data from a third-party connector, such as Twitter, Facebook, Google Analytics, etc.

 

 

 

 

 

 

 

Expand
titleTransformation Steps

Use a transformation step to transform or convert the connected data.

 

Transformation Step Types

Section
Column

Image Removed

Column

Icon

Transformation type

Description

Image Removed

 

Aggregate Step

This step summarises data including the ability to count, sum and average metric fields.

 Image Removed

Calculated Field

This step creates a calculated field based on other fields in the step.

 Image Removed

Filter

This step is for filtering data in a step.

 Image Removed

Merge

This step merges two sets of data based on the configured Join Fields.

 Image Removed

Split

This step duplicates an input dataset to create identical output datasets.

 

 

 

Expand
titleOutput Step

Save the transformed data into a database using an output step.

Output Step Types

Section
Column

Image Removed

Column

Icon

Transformation type

Description

Image Removed

SQL Database

 

This outputs data to a selected writeable data source. There are multiple options to create and manage tables and indexes, and to insert or update data.

 

 

 

 

Expand
titleConnectors

Connectors are used to join steps together and create a relationship between them. Data will flow from one step to another step. Click on a step to reveal its connecting points. These points are then used to connect one step to another. The flow of a connector is represented with an arrowhead at the end of it.

 

Connection rules

These rules are applicable on step connecors (running left to right). 

  • An input step can be connected to only one transformation or output step.
  • A transformation step cannot be connected to an input step, but to another transformation or output step.
  • All types of transformation steps, except the split step, can only be connected to one other step.
  • A split step can be connected multiple times.
  • Connections can only be made to an output step, but it cannot be the origin of a connection.

 

Breaking a Connection

Once a connection is created between two steps, it can be broken or deleted. Simply right-click on one of the steps, and click on Break Connections. This will break all the connections associated with that step.

Image Removed

Alternatively right-click on the connector itself and select Break Connections.

 

 

 

Expand
titleStep Functions

Once an input step is added to the canvas, right-click on it to see the functions that can be performed on it.

These are explained below:

 

FunctionDescription

Copy

To create a copy of the step.

Break Connections

To break any connections that the steps has with other steps.

Delete

To delete the step.

 

 

 

Configuration panel

 

Click here learn more about this panel.

 

Data preview panel

 

Click here learn more about this panel.