Replicating data between transactional databases and ClickHouse®

Speaker(s):
Kanthi Subramanian
Kanthi Subramanian
Arnaud Adant
Arnaud Adant
Nov-21 16:30-17:00 UTC (2024-11-21T16:30:00.000Z-2024-11-21T17:00:00.000Z your timezone)
Add to Calendar 11/21/2024 4:30 PM 11/21/2024 5:00 PM UTC OSACon: Replicating data between transactional databases and ClickHouse® Presented by Kanthi Subramanian & Arnaud Adant.

Transactional databases like MySQL, PostgreSQL and MongoDB are usually not a great fit for real time analytics, especially as the data volume grows.

They are also less space efficient than columnar databases and require regular purge or archival. This talk presents a solution to synchronize data in real time between MySQL and ClickHouse. The Altinity Sink Connector open source project (https://github.com/Altinity/clickhouse-sink-connector) is designed to efficiently replicate data and schema changes with accuracy, operational simplicity and performance in mind. It also provides tools to checksum and efficiently dump and load Terabytes of data. The Connector is now generally available.

 https://us.airmeet.com/e/69f1f9b0-2f11-11ef-82f4-1d5f1667121e
By Kanthi Subramanian Arnaud Adant

Transactional databases like MySQL, PostgreSQL and MongoDB are usually not a great fit for real time analytics, especially as the data volume grows.

They are also less space efficient than columnar databases and require regular purge or archival. This talk presents a solution to synchronize data in real time between MySQL and ClickHouse. The Altinity Sink Connector open source project (https://github.com/Altinity/clickhouse-sink-connector) is designed to efficiently replicate data and schema changes with accuracy, operational simplicity and performance in mind. It also provides tools to checksum and efficiently dump and load Terabytes of data. The Connector is now generally available.