I’m wondering if it is possible to send a feed of successful BigQuery inserts, passing as fully mapped JSON much like how the failedInserts forwarder works.
Subscribing to the enriched-good PubSub topic returns data in the TSV JSON data-only format like so:
value_one value_two value_three
While I can subscribe to this, it means I have to do the column name mapping myself. Ideally I’d let the BigQueryLoader perform the mapping, then retrieve the mapped JSON like so:
Just wondering if it’s possible to do this, or if I should just stick with performing the header mapping myself, which does seem error-prone. I’ve been using Snowplow for a few weeks now and it’s been great, only now I am trying to carry out tasks which don’t appear to be documented.