I’m trying to enable the Elasticsearch sink on our batch pipeline to send the bad rows to our Elasticsearch cluster. Is it possible to enable AWS request signing?
There isn’t anything obvious in the config file however I can see that it has been enabled in the real-time pipeline.
Is it possible for the
index to be parameterised?
At present we have a index per day and it might make sense to add the rows into there.