we updated from v85 -> v87 some days ago and we encounter some problems. We have a remaining “processing_folder” in our snowplow-logs directory (basically the raw events input directory). I don’t know why this folder is in there and believe it should be deleted if the run was done.
a more obscure thing is, that the cron job exits everytime with
Error running EmrEtlRunner, exiting with return code 1. StorageLoader not run, but it works, if I just call it in the terminal, it’s the
snowplow-runner-and-loader.sh and it’s exactly like the original one in the repo. If I then run the storage-loader alone, it breaks with
couldn't find atomic-events folder in enriched-good so why does the EMR-ETL doesn’t run, what else does he check?