We recently switched from Snowplow v2.3.0, which I think is about the same as R66, to R95. We had to do this rather suddenly on 12/15, when AWS removed AMI-3.6.0 from EMR, and our ETL jobs quit working.
Rather than try to upgrade through 29 or so releases, we’re working with a fresh installation of R95 now.
Everything seems to be working OK, except: Now there is no unstruct_event column in atomic.events.
We had one type of unstruct event that was not being shredded into its own table. Instead, in downstream processing, we grabbed the json out of the unstruct_event column and parsed it ourselves. (We did this because it is a fairly new data enhancement we get from a third party API, and their json record layout is subject to change.)
So my question is: Is this raw json still being written to Redshift, somewhere I haven’t found it yet? Or can it be?