We’re excited to release Snowplow RDB Loader 1.1.0 that adds metrics to the loader.
Each time the loader performs a load into Redshift (after reading a message from SQS), these metrics are exported :
latency_collector_to_load_min: delay between maximum collector timestamp and load timestamp in seconds
latency_collector_to_load_max: delay between minimum collector timestamp and load timestamp in seconds
latency_shredder_start_to_load: delay between start of shredder and load timestamp in seconds
latency_shredder_end_to_load: delay between end of shredder and load timestamp in seconds
count_good: number of good events loaded
These metrics can be exported to 2 different places (possibly at the same time):
- A statsd server
- In the logs, with one line per metric
This can be configured with this new part of the configuration file.