Selective events in data stores


#1

Hi is it possible to send selective events to a data store?

For example, I am using the real-time pipeline to save events in S3 and Elasticsearch. I would like to have all the events in S3, but in Elasticsearch, I would only like to have page_view events. Possible?


#2

The Elasticsearch sink doesn’t have any way of filtering events but you could achieve this by filtering the enriched stream to a page_view only stream (e.g., using Kinesis Tee or Kinesis Analytics) and then using this as the source stream to the Elasticsearch sink.