EMR jobs are failing intermittently but increasingly with this error:
com.amazon.ws.emr.hadoop.fs.shaded.com.amazonaws.SdkClientException: Unable to find a region via the region provider chain. Must provide an explicit region in the builder or setup environment to supply a region.
(Plus lots more Java traceback blather.)
We’re seeing this once every week or two, out of running snowplow-emr-etl-runner six times a day.
Seems like it can happen at any stage.
Has anyone else run into this problem? Intermittents are the worst.