Monitoring
Gluesync 2 provides a comprehensive monitoring stack that combines three powerful monitoring approaches:
Control Plane UI
The Control Plane provides an intuitive web interface for real-time monitoring of your Gluesync deployment. It offers:
-
Immediate visibility into pipeline status and health
-
Real-time operational metrics and system state
-
Basic troubleshooting capabilities
-
Quick access to system configuration
For detailed information, see Control Plane Monitoring.
Prometheus Integration
Prometheus serves as the backbone for metrics collection and storage in Gluesync. It comes pre-configured with every kit with some basic settings you can adjust and fine tune based on your needs:
services:
prometheus:
image: prom/prometheus
restart: 'unless-stopped'
volumes:
- ./prometheus-gs2.yml:/etc/prometheus/prometheus.yml
- ./data:/prometheus
command:
- '--config.file=/etc/prometheus/prometheus.yml'
- '--storage.tsdb.retention.size=10GB'
- '--storage.tsdb.retention.time=7d'
ports:
- 9090:9090
Default config include:
-
Metrics collection with 7-day retention
-
10GB storage capacity for historical data
-
Automatic restart capability
-
Pre-configured prometheus.yml for Gluesync metrics
For implementation details, see Prometheus Integration.
Grafana Dashboards
Gluesync ships with pre-built Grafana dashboards that provide comprehensive pipeline monitoring:
-
Real-time performance metrics showing read/write latencies
-
End-to-end pipeline timing visualization
-
Data transfer volume tracking with historical trends
-
Row count monitoring across all tables
The default dashboard includes:
-
Latency graphs for read and write operations
-
Pipeline-specific timing metrics
-
Total data transferred monitoring
-
Row count transfer tracking
For dashboard setup and customization, see Grafana Dashboards.