BigQuery Loader 1.1.0 released

Announcements New releases
1

We are pleased to announce version 1.1.0 of the Snowplow BigQuery Loader.

This release brings logging capability to Stream Loader and adds Sentry integration to Stream Loader, Mutator, and Repeater.

Logging on Stream Loader

We’ve added some new logs to Stream Loader to reflect better what is happening in the application. New logs are showing application start and shutdown. Also, we’ve added logs that show application statistics such as good event count, bad event count, count of the events failed to insert. These statistics are logged periodically. The period of the statistics logs is configurable. Also, the statistics logs are off by default. To enable them, you need to add the following under monitoring section:

"stdout": {
  # Reporting period with time unit
  "period": "1 min"
  # Optional
  "prefix": "snowplow.monitoring"
}

Sentry integration

Sentry is application for error tracking. We’ve added Sentry integration to BQ Loader applications to send exceptions from these applications to Sentry instance which you specified. Sentry integration can be activated by adding following under monitoring section:

"sentry": {
  "dsn": "http://sentry.acme.com"
}

Upgrading to 1.1.0

If you are already running version 1.0.x then you can switch to the 1.1.0 docker images without any changes to your configuration.

docker pull snowplow/snowplow-bigquery-streamloader:1.1.0
docker pull snowplow/snowplow-bigquery-loader:1.1.0
docker pull snowplow/snowplow-bigquery-mutator:1.1.0
docker pull snowplow/snowplow-bigquery-repeater:1.1.0

If you would like to activate statistic logs, you need to add the following stdout configuration under monitoring section as described previously:

"stdout": {
  # Reporting period with time unit
  "period": "1 min"
  # Optional
  "prefix": "snowplow.monitoring"
}

To upgrade from previous versions, check out our documentation and upgrade guide.

3 Likes