Page History

1. Click on the Create button in the top-right corner.

2. Then select the Transformation Flow option. 
   
   

   Note
   If you do not see this option, you may not have security access to transformation flows. Learn how to get access here.

   
   
   
   
   
   

3. You will be taken to the transformation flow builder.

4. Hover your cursor over the Input Steps button on the left side to make the panel appear. (Click here to learn more about each of these input steps.)
   
   
   
   

5. Then drag Drag an input step from this panel onto the canvas. (For this procedure, we will use the single database table as an example. Click here to learn about the different input steps.)

6. On doing so, a popup will appear, requiring information on the selected data source. (The steps within this popup will differ for each type of input step.)
   
   
   
   

7. Select the data source, and then a single table (since our selected input was a single table).

8. Then click on the Submit button. 
   
   
   
   

9. Next, click on the newly created input step in the canvas. Its details will appear in the configure flow panel. 
   
   
   
   

10. Note: Clicking on a blank space in the canvas will show details of the entire flow, but clicking on a specific step shows only that step’s configurations.

11. If required, you can rename the input step. Click on the Details tab in the Configuration panel, and provide a new name, or even an updated description. 
    
    
    
    

12. Click on the Configure tab and select only the fields that you want data to be extracted from.

13. Click on the Add Filter button to apply filters to control the data being extracted, when the Filter popup appears. 
    
    
    
    

14. Once you’re done with the configuration, click on the Apply button. 
    
    

    Warning
    You must click on the Apply button to save the configuration details. If you do not click on this button, and click somewhere else first, you will lose the configuration details.

    
    
    
    

15. On doing so, the data preview panel will display the data extracted from the configured data source. A maximum row setting of 200 applies. 
    
    
    
    

16. You can apply transformations to fields directly from the data preview panel. Click here to learn more.

17. A new Fields tab will also appear in the Configuration panel. Use this to manage the data fields that are extracted from the step. 
    
    
    
    

go back

Once a flow has been created, you can save and publish it. Although draft flows you can be manually executed execute draft flow, scheduled flows will have to be published in order to be executed.

Only valid flows may be published. A flow is valid when:

• It has at least one output step.
• All steps are configured.
• All steps have the correct number of inputs and outputs connected.

1. Click on the Publish button to do so.
   
   
   
   

2. Provide details in the popup that appears.
   
   

go back

Once a flow is created, you can either execute it manually or schedule its execution.

Manual Execution

This process shows how to execute the transformation flow manually:

1. Navigate to left side menu > Browse > Transformation Flows. 
   
   
   
   

2. Locate the flow that you want to run, and click on its menu icon. (The menu icon will appear when you hover the cursor on the bottom-right corner of the thumbnail. This menu can also be invoked by right-clicking the flow.)
   
   
   
   

3. Then click on the Run Transformation option. 
   
   
   

go back

Scheduled Execution

Here’s how to schedule a data transformation flow to be executed through the scheduler:

1. Click on the schedule button in the transformation builder's header menu. 
   Image Removed
   Image Added
   
   

2. When the scheduling popup appears, click on the button to enable it. 
   
   
   
   

3. Provide scheduling details to run the batch at specified intervals:

1. Click on the Recipients textbox to select users to notify when the batch has executed successfully. You can add individual users and even groups. 
   
   
   
   

2. Choose frequency with which to run the transformation flow.

3. Enable option to limit schedule period. This allows you to establish a time period within which the batch will be executed. Once the end period passes, the transformation will stop being executed. 
   
   
   
   

4. Enable the Failure Notification button and add user groups to notify if the transformation failed to be executed. 
   
   
   
   

5. Finally, click on the Submit button.

go back