Event aggregation in the stream?

For data modelers & consumers
1

Has anyone ever tried to aggregate events within the event stream?

From: http://snowplowanalytics.com/guides/data-modeling/

Apparently it’s possible to use the stream itself for data modeling, but I’ve been looking around and couldn’t find examples of where someone has attempted this. All the data modelling examples I’ve seen require SQL/Looker - I’d prefer to do the aggregation within the stream.

Thanks!

2

You can find one example of doing aggregation/near real time processing in this CodeCombat case study.

Depending on the complexity of what you want to do there’s various different ways to solve this problem in terms of reading and processing data off the Kinesis stream.

4 Likes