Apache Kafka Agent for Gluesync: Target Integration

Index

Core principles

Gluesync offers support for streaming data through Apache Kafka to let you focus on the development of your modern application stack and leave all the complexity of handling data sourcing from relational, NoSQL databases and data lakes to it.

Data could be modeled accordingly to your needs using Gluesync’s data modeling features and then sent immediately to a designated Kafka topic where it has written permissions to stream changes.

Communication between this agent and Apache Kafka is achieved through Kafka Java SDK.

Change data capture

This agent does not currently support reading incremental changes from Apache Kafka.

Platform supported features

Feature	Support	Notes
Target role	✅	Publishes records to Kafka topics via the official Java client (including Confluent Cloud).
Source role	❌	Connector is target-only; it does not consume from Kafka.
Snapshots	❌	Not supported, as this agent does not supporting reading from Kafka.
CDC	❌	This agent does not currently support reading incremental changes from Apache Kafka.
CDC type	N/A	This agent does not currently support reading incremental changes from Apache Kafka.
Bulk load	N/A	Kafka producer batching already optimizes throughput; no staging tables.
Source persisted internal cache	N/A	State tracking resides in Core Hub; producer keeps no disk cache.
Target persisted internal cache	N/A	Messages are sent straight to Kafka brokers; no extra buffering.
Driver / connector	Kafka Java SDK	Supports SASL/SCRAM-256/512, TLS, and unauthenticated clusters.
Chains	N/A	Target-only connector.
Truncate operation support (reading)	N/A	Target-only connector.
Truncate operation support (writing)	N/A	Kafka topics are append-only; agent does not delete records.

Feature

Support

Notes

Target role

✅

Publishes records to Kafka topics via the official Java client (including Confluent Cloud).

Source role

❌

Connector is target-only; it does not consume from Kafka.

Snapshots

❌

Not supported, as this agent does not supporting reading from Kafka.

CDC

❌

This agent does not currently support reading incremental changes from Apache Kafka.

CDC type

N/A

This agent does not currently support reading incremental changes from Apache Kafka.

Bulk load

N/A

Kafka producer batching already optimizes throughput; no staging tables.

Source persisted internal cache

N/A

State tracking resides in Core Hub; producer keeps no disk cache.

Target persisted internal cache

N/A

Messages are sent straight to Kafka brokers; no extra buffering.

Driver / connector

Kafka Java SDK

Supports SASL/SCRAM-256/512, TLS, and unauthenticated clusters.

Chains

N/A

Target-only connector.

Truncate operation support (reading)

N/A

Target-only connector.

Truncate operation support (writing)

N/A

Kafka topics are append-only; agent does not delete records.

Security

Gluesync supports the SASL SSL authentication mechanism against Kafka with both SCRAM-256 and SCRAM-512 algorithms, as well as non-authenticated Kafka clusters.

Supported version

This agent supports any version of Kafka, including Confluent Cloud.

Q&A

I am using a different authentication mechanism, is it supported? We’re open to supporting a wider spectrum of different authentication mechanisms and features. Please drop us a line writing at this email address: Contact MOLO17.