This section deals with the interesting bits involved in fully implementing a step. A step that implements the ETLStep interface will be recognised as a Data Transformation step. However, Yellowfin has partially implemented the interface and provides a few abstract classes to make implementation easier. We recommend extending these abstract classes:
Class | Purpose |
---|---|
AbstractETLRowStep | Extend this class if the step is required to process data row by row and output data as and when it is processed. Filter and Calculated Field are examples of row steps. |
AbstractETLCachedStep | This class should be extended if the step is required to accumulate data before it can begin processing. For example, Merge and Union are cached steps. |
AbstractETLInlineRowStep | Inline transforms are expected to be row steps. Extend AbstractETLInlineRowStep to implement an inline transform. |
Depending on which abstract class is used different methods need to be implemented. There are some common aspects though. For ease of understanding, the implementation details are split into three sections: