Dataflow Steps

Dataflow steps are the building blocks from which dataflow logic is composed.

All dataflow steps have the Step Name field where you can input a name of a step — the best practice is to assign a name that describes what this step does (e.g., "Get client data from an external system").

Additionally, every dataflow step, with the exception for Input group steps, has the Source Step field where you need to select a previous step after which the current step is executed. This allows complex step execution order and branching during the dataflow processing. Input steps (except for Input File) do not have the Source Step field, thus, they can be used as first steps in a dataflow.

Dataflow Steps Groups

All steps are combined into 4 groups (starting from 0.7.0 - earlier there were 5 groups):

• Input - group that is responsible for all incoming data in the Dataflow
• Output - group that contains steps responsible for all outgoing data, internally as well as into external systems
• Model transformation* - steps that are responsible for data transformation and user interface management (starting from 0.7.0 and later)
• Users&Contexts - steps that are responsible for user management - including user creation, password management, role management, etc.
• Other - group of steps that is responsible for user interface management (the group is removed starting from 0.7.0)

Every dataflow starts with one of the steps from the Input group followed by any number of steps from the Model transformation, Users & Contexts, and Output groups and ends with one of the steps from the Output group - usually it is Write response or Apply deferred updates.

Input Steps Group

The Input Steps group contains steps that that set an initial data model for any Dataflow.

This data model can be modified during the Dataflow with the help of the Model transformation steps.

Dataflow data model

You can view data model in JSON by clicking ‘eye’ icon the upper right corner of any step inside a dataflow. The example of ‘eye’ icon is shown on the screenshot below (leftmost of the 3 icons in the upper-right corner).