[EDIT-2: 0.6.1 is now out: BigQuery Loader 0.6.1 released .]
[EDIT: We have discovered a bug in version 0.6.0 that can lead to contexts being dropped from the event. Please do not upgrade to this version. We’re working on a fix and will update soon.]
We are very excited to have released version 0.6.0 of BigQuery Loader, our family of apps that load Snowplow data into BigQuery.
The main highlight of this release is the introduction of BigQuery StreamLoader, a standalone Scala app (in the vein of Repeater and Mutator) that can be deployed as an alternative to the Loader Dataflow job. Loading into BigQuery is a relatively simple task. It doesn’t require much aggregation or data shuffling and so isn’t benefiting from some of Beam’s key analytics features.
This component still has experimental status, but we are very keen to get into users’ hands and hear your feedback on it.
This version fixes a bug in Mutator where a
projectId passed in through the config file was being ignored. Many thanks to simplylizz for contributing this fix.
We’ve fixed the versions of several transitive dependencies to address security vulnerabilities in those libraries.
For the full release notes, check out: