The documentation implies that the tool to mirror the contents of a Kinesis stream to S3 files was developed to read raw events from a collector. The question I have is whether or not that tool can read enriched events from a Kinesis stream instead?
In other words, assuming my goal is only to load enriched events into Redshift can I use a pipeline like:
collector -> Kinesis -> enrich -> Kinesys -> LZO/sink -> S3 -> storage-loader -> Redshift
That avoids some S3 complexity at the cost of loosing the ability to push “raw” events into Redshift.