LoadError after upgrading to R109


#1

Hi
we’ve recently upgraded our staging environment from R106 to R109.
we are using the batch pipeline, executing it hourly via cron.
since the upgrade to R109, around 1/3 of these runs fail with the following error message:

uri:classloader:/gems/avro-1.8.1/lib/avro/schema.rb:350: warning: constant ::Fixnum is deprecated
uri:classloader:/gems/json-schema-2.7.0/lib/json-schema/util/array_set.rb:18: warning: constant ::Fixnum is deprecated
D, [2018-10-08T04:04:21.086677 #4964] DEBUG – : Initializing EMR jobflow
LoadError: load error: META-INF/main – java.lang.StackOverflowError: null
require at org/jruby/RubyKernel.java:970
require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59

at :3 ERROR: org.jruby.embed.EvalFailedException: (LoadError) load error: META-INF/main -- java.lang.StackOverflowError: null

any idea what is the reason for it & how to solve it?
we are holding back the upgrade of the production env till it’ll be solved.

thabks a lot in advance for your help!


#2

Hi @morans,

What version of the EmrEtlRunner are you using? Have you downloaded the appropriate release?

Looking at the error message, it seems you are still using R108 which has a bug (more info here).

To fix the problem, you can:

Hope this helps.


#3

Thank you Egor!
You are abselutely right, I was using R108 (somehow missed that R109 had a new binary).