đī¸ Avro format
Avro is very popular in streaming data pipeline. Now seatunnel supports Avro format in kafka connector.
đī¸ Canal Format
Changelog-Data-Capture Format Format Deserialization Schema
đī¸ CDC Compatible Debezium-json
SeaTunnel supports to interpret cdc record as Debezium-JSON messages publish to mq(kafka) system.
đī¸ Debezium Format
Changelog-Data-Capture Format Deserialization Schema
đī¸ Kafka source compatible kafka-connect-json
Seatunnel connector kafka supports parsing data extracted through kafka connect source, especially data extracted from kafka connect jdbc and kafka connect debezium
đī¸ MaxWell Format
Maxwell is a CDC (Changelog Data Capture) tool that can stream changes in real-time from MySQL into Kafka, Kinesis and other streaming connectors. Maxwell provides a unified format schema for changelog and supports to serialize messages using JSON.
đī¸ Ogg Format
Oracle GoldenGate (a.k.a ogg) is a managed service providing a real-time data mesh platform, which uses replication to keep data highly available, and enabling real-time analysis. Customers can design, execute, and monitor their data replication and stream data processing solutions without the need to allocate or manage compute environments. Ogg provides a format schema for changelog and supports to serialize messages using JSON.
đī¸ Protobuf Format
Protobuf (Protocol Buffers) is a language-neutral, platform-independent data serialization format developed by Google. It provides an efficient way to encode structured data and supports multiple programming languages and platforms.