R88 - EmrEtlRunning sample config doesn't work?

[timgriffinau]

Hi,

I’m upgrading to R88 and have started with a brand new config.yml as the structure has changed quite a bit over the releases.

These are the versions I am using:

• http://dl.bintray.com/snowplow/snowplow-generic/snowplow_emr_r88_angkor_wat.zip
• https://github.com/snowplow/snowplow/blob/master/3-enrich/emr-etl-runner/config/config.yml.sample

Now when I ran snowplow-storage-loader and snowplow-emr-etl-runner there was a huge discrepancy in the format.

Things like:

• Expecting hadoop_shred, but fields like rdb_loader, rdb_shredder were in the one above
• Expecting storage : download : folder
• etc.

Can anyone confirm which version I should be using? I assume config.yml.sample hasn’t been updated to R88?

Thanks!

[egor]

Hi @timgriffinau,

R88 isn’t the latest release of Snowplow. Some new releases were introduced afterward:

• Snowplow 89 Plain of Jars
• Snowplow 90 Lascaux

So, the config file which you’re using is for the Snowplow R90. The right config file for R88 you can find here. All necessary changes are described in the “Upgrading” section of the introduction post.

Hope this helps.

Regards,
Egor

[timgriffinau]

Thanks so much egor. I must have found R88 on the hosted assets page or something.