As we are moving through the base Snowplow configuration we had some requirement from our BI team.
We basically want to load the entire Snowplow atomic.events to our own table or alternatively add some fields to the current atomic.events table.
I know I can load my own data to other tables and was successful in doing so.
However, our BI team does not want to constantly join with atomic.events and want to partition the data daily. We are basically very keen on using the enrichment features of snow plow and the entire pipe line but want to control the loading process and simplify it for our BI process.
Any thoughts on how can I proceed with this?