I have deployed a data collection pipeline implemented on AWS using lambdas (java 11). When an event is received by our API-Gateway a series of lambdas are invoked to get information from an API pass that to SQS, another lambda then process the data and fires a snowplow structured event to our collector.
I have an AWS lambda function that creates a snowplow tracker and emitter fires an event to our collector and finishes.
I’m using the SimpleEmitter which creates a runnable task and executes it via executor service
Sometimes the main thread finishes before the executor is invoked (as my lambda is very small) and the event isn’t fired, and no error message
- I couldn’t find a “blocking emitter” that i could use? (I don’t want to use version 0.7.0 )
- Is there a better solution all together to fire events from AWS lambda?
I would appreciate any advice from your experience