We’ve got a relative new snowplow deployment (2 weeks in prod) close to out of the box config with scala collector -> kinesis -> s3 sink -> emr enrich and shred -> load to redshift.
We’ve had a couple of instances where the redshift load fails. It fails because of an invalid negative value for derived_tstamp.
e.g. derived_tstamp=-5967-09-11 11:10:28.569
Can someone tell me why this might of happened and how to stop it happening?