Kafka Connect: Source & Sink

Connectors move data declaratively. Don't write that integration in code.

0/3 done

Configure, don't code

The Connect framework

Kafka Connect is a JSON-configured framework of source connectors (read from X, write to Kafka) and sink connectors (read from Kafka, write to Y). You ship Connect workers — never plain Java code — for integration paths.

Single Message Transforms (SMTs) apply per-record edits inline: mask PII, rename fields, cast types, route by content. SMTs are composed in order.

S3 sink connector config (JSON)

Author the POST /connectors payload that ships records from orders.enriched to S3 in Avro, partitioned by event date, with a 60s flush interval and PII masking via a MaskField SMT.

Reading in progress · 0 of 3 activities done