I’ve got the snowplow collector, enrichment and kinesis stream working but I can’t figure out how to get rid of the Thrift data stored in the raw kinesis stream and it’s stopping me from being to take this payload and pass it to other systems.
In the image below, you can see the serialised data at the top with the encoding characters, but I do not want to have it in my
kinesis.records.data JSON, but I can’t seem to figure out how to remove it. All I would like is the properly formatted JSON below it
I have the following streams…
Can someone help me figure out how to get rid of that so I can finish my demo prep?