Pipeline management

Pipelines are the data streaming heart of Datamin. The UI canvas and the powerful engine behind it allow our users to orchestrate the entire process between receiving input data from outside to sending it to a destination. It is also a place where you will spend most of your time at Datamin.

Pipeline management canvas is a drag-and-drop no-code interface where you can create tasks, connect them, configure each task, and run and schedule pipelines.

In the next pages you will learn about:

• 13 types of tasks you can build your pipelines from

• How to schedule pipelines, trigger in real-time, on-demand or via our API

• How to use the library or templates

• How to expand the functionality of your pipelines with environment variables, mathematical functions, and formatted messages.