WAL or Change Data Capture (CDC) Based Replication
Below table shows supported features and features we are working on for WAL or CDC Based replication from Postgres to different targets. ✅ means supported. 🛠️ means Work in Progress and Coming Soon!.Warehouses
| Feature | Snowflake | BigQuery | Clickhouse | Postgres | S3/GCS |
|---|---|---|---|---|---|
| Initial Snapshot - Parallelizable | ✅ | ✅ | ✅ | ✅ | ✅ |
| Incremental Sync (CDC) | ✅ | ✅ | ✅ | ✅ | ✅ |
| DML Support - INSERT, UPDATE and DELETE | ✅ | ✅ | ✅ | ✅ | ✅ |
| Schema Changes | ✅ | ✅ | ✅ | ✅ | ✅ |
| Soft Delete | ✅ | ✅ | 🛠️ | ✅ | ✅ |
| Partitioned Tables | ✅ | ✅ | ✅ | ✅ | ✅ |
| Advanced Types - Arrays, JSONB, HSTORE, Geospatial etc. | ✅ | ✅ | ✅ | ✅ | ✅ |
| Advanced Monitoring - Lag, Throughput, Postgres Wait Events etc | ✅ | ✅ | ✅ | ✅ | ✅ |
| Resync Mirrors | ✅ | ✅ | ✅ | ✅ | ✅ |
| Column Exclusion | ✅ | ✅ | ✅ | ✅ | ✅ |
| Add Tables | ✅ | ✅ | ✅ | ✅ | ✅ |
Queues
| Feature | EventHubs | Kafka | Redpanda | PubSub |
|---|---|---|---|---|
| Initial Snapshot - Parallelizable | 🛠️ | ✅ | ✅ | ✅ |
| Incremental Sync (CDC) | ✅ | ✅ | ✅ | ✅ |
| DML Support - INSERT, UPDATE and DELETE | ✅ | N/A | N/A | N/A |
| Schema Changes | ✅ | 🛠️ | 🛠️ | 🛠️ |
| Partitioned Tables | ✅ | ✅ | ✅ | ✅ |
| Advanced Types - Arrays, JSONB, HSTORE, Geospatial etc. | ✅ | ✅ | ✅ | ✅ |
| Advanced Monitoring - Lag, Throughput, Postgres Wait Events etc | ✅ | ✅ | ✅ | ✅ |
| Resync Mirrors | 🛠️ | N/A | N/A | N/A |
| Column Exclusion | ✅ | ✅ | ✅ | ✅ |
Query Based or Watermark Based Replication
Below table shows supported features and features we are working on for Query Based or Watermark Based Replication from Postgres to different targets. ✅ means supported. 🛠️ means Work in Progress and Coming Soon!.| Feature | Snowflake | BigQuery | Postgres | S3/GCS |
|---|---|---|---|---|
| Initial Snapshot | ✅ | ✅ | ✅ | ✅ |
| Incremental Sync Based on Watermark | ✅ | ✅ | ✅ | ✅ |
| DML Support - INSERT, UPDATE (if updated_at & primary key are present) | ✅ | ✅ | ✅ | ✅ |
| Schema Changes - ADD COLUMN | ✅ | 🛠️ | 🛠️ | 🛠️ |
| Resync Mirrors | ✅ | 🛠️ | 🛠️ | 🛠️ |
| Partitioned Tables | ✅ | ✅ | ✅ | ✅ |
| Advanced Types - Arrays, JSONB, HSTORE, Geospatial etc. | ✅ | ✅ | ✅ | ✅ |
| Advanced Monitoring - Throughput, Postgres Wait Events etc | ✅ | ✅ | ✅ | ✅ |
| Column Exclusion | ✅ | ✅ | ✅ | ✅ |
Transformations
Below table shows what targets we support transformations and their status| Target | Status |
|---|---|
| EventHubs | ✅ |
| Kafka / Redpanda | ✅ |
| PubSub | ✅ |
| Snowflake | Private Preview |
| BigQuery | Private Preview |
| Clickhouse | Private Preview |
| Postgres | Private Preview |
| S3/GCS | Private Preview |