I had a question regarding events which are sent in a POST request and are failing validation.
We are sending multiple events at once to the scala stream collector using POST requests.
Those events are then stored on S3 and processed by the EmrEtlRunner to be loaded in Redshift.
We’ve noticed that when an event fails validation, a file is generated in the enriched/bad folder containing the whole POST request with the failed event.
We were wondering if that meant that all the events in that POST request have failed validation (meaning they are not successfully loaded in Redshift) or if only the failed event won’t be successfully loaded in Redshift?