Databricks Agent for Gluesync: Target Integration
Core principles
This agent writes into Delta Lake tables registered in Unity Catalog. It runs SQL on a Databricks SQL warehouse through the Databricks SQL Statement Execution API, so Core Hub needs only outbound HTTPS to the workspace: no JDBC driver, no cloud-storage credentials and no external location.
Every change is applied with a Delta MERGE matched on the key, so inserts, updates and deletes keep the table equal to the source, and a batch replayed after a restart leaves the table as it was.
Supported version
Any Databricks workspace with Unity Catalog and a SQL warehouse (serverless, pro or classic), on AWS, Azure or Google Cloud, including Databricks Free Edition.
Platform supported features
| Feature | Support | Notes |
|---|---|---|
Target role |
✅ |
Writes Delta tables in Unity Catalog through a SQL warehouse. |
Source role |
❌ |
Current release supports Databricks only as a target. |
Snapshots |
✅ |
Snapshot batches are written as key-matched |
CDC |
❌ |
Current release supports Databricks only as a target. |
CDC type |
N/A |
Current release supports Databricks only as a target. |
Bulk load |
✅ snapshot |
Snapshots can be staged and loaded from a Unity Catalog volume, one |
Database pooling |
N/A |
The Statement Execution API is stateless HTTPS: there is no connection to pool. |
Source persisted internal cache |
N/A |
Target-only connector. |
Target persisted internal cache |
N/A |
Writes flow directly to the SQL warehouse—no intermediate storage. |
Driver / connector |
Databricks SQL Statement Execution API |
HTTPS from Core Hub to the workspace, authenticated with an OAuth service principal or a personal access token. |
Chains |
N/A |
Target-only connector. |
Truncate operation support (reading) |
N/A |
Target-only connector. |
Truncate operation support (writing) |
✅ |
Honors the Core Hub "truncate before snapshot" option, with |