Trouble sending bad rows to amazon elasticsearch service (EsHadoopInvalidRequest)

[Timmycarbone]

It’s set to true yes.

Anyway, I went with Athena too in the end. Here’s the reference for whoever lands here:

Debugging bad rows in Athena [tutorial]

Debugging bad rows in Athena [tutorial] One of the features that makes Snowplow unique is that it is a non-lossy pipeline: any data that hits the pipeline but isn’t successfully processed, rather than being dropped is preserved as ‘bad rows’ with (hopefully) helpful error messages indicating why those rows did not successfully validate. This is invaluable when you’re rolling out new tracking, to test that the tracking is working properly, and to make ongoing monitoring of your data quality over …