What is Dataflow?

Dataflow is a set of automated operations focused on managing data that can be received from forms, Aqtra components, over external interfaces or via other means. The data can be automatically queried, transformed and transmitted both internally to Aqtra components, as well as externally over integration APIs. Additionally, Dataflows can execute workflows and even manipulate UI - for example open specific forms or components.

Dataflows consist of two main components:

• Stages - a logical construct that allows grouping of Dataflow Steps into logical, sequential groups (e.g. Get Initial Data - Transform the Data - Update Relevant Data Components)
• Steps that comprise each Stage. Each step is an atomic operation that has to be performed before dataflow proceeds further. For example, Lookup Reference step extract the necessary data from selected data source, and then stores it internally making it available for the next steps.

Visual builder of Dataflow

Dataflow Visual Builder is visual editor allowing creation and management of Dataflows.

Dataflow Visual Builder allows:

• Adding and (re-)naming new Stages for a Dataflow
• Adding, (re-)naming and setting up new Steps inside each Stage

Once created, dataflow are laid out from left to right in Stages, while Steps inside each Stage is stacked top to bottom, as shown below. It is worth mentioning that unlike Workflow steps, Dataflow steps have an option to selecting a previous step, and the selected Source step should always be before (on top and to the left) of the current Step.

Add / Remove new Stage

To add a new stage, press a Add Stage button on the top of the Dataflow Visual Builder. If you click on the Edit (pencil icon) button on the Stage, you can also rename it as you see fit. You can add unlimited number of Stages.

To remove a workflow Stage, press “X” button on the right of the stage name as shown below.

(Re)Name Stage

You can rename a Stage as necessary, using a Pencil icon button on the right of the Stage name as shown below.