Snowplow RDB Loader 1.1.0 released

We’re excited to release Snowplow RDB Loader 1.1.0 that adds metrics to the loader.

Each time the loader performs a load into Redshift (after reading a message from SQS), these metrics are exported :

  • latency_collector_to_load_min: delay between maximum collector timestamp and load timestamp in seconds
  • latency_collector_to_load_max: delay between minimum collector timestamp and load timestamp in seconds
  • latency_shredder_start_to_load: delay between start of shredder and load timestamp in seconds
  • latency_shredder_end_to_load: delay between end of shredder and load timestamp in seconds
  • count_good: number of good events loaded

These metrics can be exported to 2 different places (possibly at the same time):

  • A statsd server
  • In the logs, with one line per metric

This can be configured with this new part of the configuration file.

5 Likes