We’re excited to release Snowplow RDB Loader 1.1.0 that adds metrics to the loader.
Each time the loader performs a load into Redshift (after reading a message from SQS), these metrics are exported :
-
latency_collector_to_load_min
: delay between maximum collector timestamp and load timestamp in seconds -
latency_collector_to_load_max
: delay between minimum collector timestamp and load timestamp in seconds -
latency_shredder_start_to_load
: delay between start of shredder and load timestamp in seconds -
latency_shredder_end_to_load
: delay between end of shredder and load timestamp in seconds -
count_good
: number of good events loaded
These metrics can be exported to 2 different places (possibly at the same time):
- A statsd server
- In the logs, with one line per metric
This can be configured with this new part of the configuration file.