Data flows are scalable data pipelines that you can build to sequence and combine data based on various data sources. Each data flow consists of components that transform data and enrich data processing with business rules.
You can create data flows that process data in different ways:
- Batch data flows
- Go over a finite set of data and eventually complete processing. Batch data flows are mainly used for processing large volumes of data.
- Real-time data flows
- Go over an infinite set of data. Real-time data flows are always active and continue to process incoming stream data and requests.
- Single case data flows
- Executed on request with the data flow source set to abstract. Single case data flows are mostly used to process inbound data.