Pipelines

A pipeline connects one source to one or more targets. Inside it, each entity maps a source table or collection to its destination and defines how that data moves.

Use this page as the map for pipeline work. If you want to build one now, go directly to Build your first pipeline.

Pipeline model

Source connector

Reads changes or snapshot rows from the source system.

Target connector

Writes those records to a destination. A pipeline can have more than one target.

Entity

The replication unit: usually one table or collection and its target mapping.

Snapshot

Copies the current contents of an entity.

Change data capture (CDC)

Continuously forwards inserts, updates, and deletes after replication starts.

The Pipelines screen is the operational home for this model. Select a pipeline to see its entities, health, throughput, and available actions.

Build and configure

Task Guide

Create a pipeline

Build your first pipeline

Add or replace a source or target

Configure connectors

Choose tables and collections

Select data in Objects Browser

Start CDC, run a snapshot, or pause replication

Run replication

Create groups and ordered chains

Organize entities

Shape and deliver data

Goal Guide

Filter source rows

Filter data

Review or change field mappings

Edit fields and mappings

Convert, mask, or derive values

Apply field functions

Reuse custom logic across entities or compose one column from several inputs

Use Custom Field Functions

Run custom transformation code

Use UDFs

Control target write behavior

Choose a write strategy

Create missing target tables

Create target tables

Operate a pipeline