I am doing some event load testing and I seem to be very bottle necked getting the data out of the enricher good kinesis data stream into s3 using the S3 loader. Are there any suggestions on the buffer settings for the S3 loader to optimize writing this amount of data into S3?
Related Topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Kinesis-S3 is taking too much time to store events into S3 buckets | 5 | 1570 | October 6, 2017 | |
| Speeding up Stream Enricher | 12 | 3191 | August 3, 2018 | |
| Scaling kinesis enricher for high loads | 11 | 2151 | December 11, 2018 | |
| Delay in s3 loader | 5 | 848 | October 30, 2022 | |
| Kinesis Streams vs S3 Buckets | 4 | 4761 | February 17, 2020 |