Conflicting issues arises in the port when running in Apache Tomcat with the port 8080 & 80

For engineers Enrichment
1

Will any one explain me the how to configure in Apache Tomcat for running the below module

  1. JavaScript tracker:
  • window.snowplow(‘newTracker’, ‘cf’, ‘127.0.0.1:8081’, {
  1. Collector Module:
  • interface = “127.0.0.1”
  • port = “8081”
  1. Enrich module:
  • collector-uri: “127.0.0.1”
  • collector-port: 8081

I used to get the following error:

[WARN] [07/21/2017 17:58:59.207] [snowplow-scala-tracker-akka.actor.default-dispatcher-2] [akka://snowplow-scala-tracker/user/IO-HTTP/host-connector-0/0] Connection attempt to 169.254.169.254:80 failed in response to GET request to /latest/dynamic/instance-identity/document/ with 5 retries left, retrying...

It tries to get connect to 169.254.169.254:80 by default after setting the above IP to localhost. What might be the possible solution for that?

2

Hi @nishanth - I don’t understand the Apache Tomcat aspects of your question, but the [WARN] you are getting is because the Snowplow Scala Tracker inside Stream Enrich is assuming it’s running in AWS and failing to find the EC2 instance metadata.

Remove the Snowplow tracking section from your Stream Enrich config file and you should be good:

3

Commenting the Optional section for tracking endpoints from the config file vanished the [WARN]. But I used to get another error. Here is the code below

# Optional section for tracking endpoints
  # monitoring {
  #  snowplow {
  #   collector-uri: "127.0.0.1"	#"169.254.169.254" 	#"{{collectorUri}}"
  #    collector-port: 8081
  #    app-id: "CFe23a"	#{{enrichAppName}}"
  #    method: "GET"
  #  }
 # }

Output from the console was

{"line":"125137401scala+stream+collector+akkaactordefault+dispatcher+2INFOakkaeventslf4jSlf4jLogger+Slf4jLoggerstarte","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.924Z"}
{"line":"125137422scala+stream+collector+akkaactordefault+dispatcher+2DEBUGakkaeventEventStream+loggerlog1+Slf4jLoggerstarted","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.937Z"}
{"line":"125137426scala+stream+collector+akkaactordefault+dispatcher+2DEBUGakkaeventEventStream+DefaultLoggersstarted","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.938Z"}
{"line":"125138158scala+stream+collector+akkaactordefault+dispatcher+3DEBUGspraycanserverHttpListener+Bindingto/1721601578080","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.939Z"}
{"line":"125138319scala+stream+collector+akkaactordefault+dispatcher+5DEBUGakkaioTcpListener+BindfailedforTCPchannelonendpoint/1721601578080javanetBindExceptionAddressalreadyinusQ==","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 2 bytes, but only got 1 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.939Z"}
{"line":"125138322scala+stream+collector+akkaactordefault+dispatcher+5WARNspraycanserverHttpListener+Bindto/1721601578080faileQ==","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 2 bytes, but only got 1 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.940Z"}
{"line":"125138333scala+stream+collector+akkaactordefault+dispatcher+5DEBUGakkaioTcpListener+ClosingserverSocketChannelafterbeingstoppec=","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.941Z"}
{"line":"125138339scala+stream+collector+akkaactordefault+dispatcher+4INFOakkaactorLocalActorRef+MessageakkadispatchsysmsgDeathWatchNotificationfromActorakka//scala+stream+collector/system/IO+TCP/selectors/a/01735555150toActorakka//scala+stream+collector/system/IO+TCP/selectors/a/01735555150wasnotdelivered1deadlettersencounteredThisloggingcanbeturnedofforadjustedwithconfigurationsettingsakkalog+dead+lettersandakkalog+dead+letters+during+shutdown","errors":[{"level":"error","message":"Error deserializing raw event: null"}],"failure_tstamp":"2017-07-24T07:21:48.941Z"}
{"line":"125138353ForkJoinPool+2+worker+5ERRORcsscscalastreamScalaCollector+Failurebindingtopors=","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 2 bytes, but only got 1 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.942Z"}
{"line":"javalangRuntimeExceptionCommandFailedBindActorakka//scala+stream+collector/user/handler+547286836/1721601578080100ListNonQ==","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 2 bytes, but only got 1 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.942Z"}
{"line":"atcomsnowplowanalyticssnowplowcollectorsscalastreamScalaCollectoranonfun3applyScalaCollectorAppscala118snowplow+stream+collector+090090=","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.943Z"}
{"line":"atcomsnowplowanalyticssnowplowcollectorsscalastreamScalaCollectoranonfun3applyScalaCollectorAppscala116snowplow+stream+collector+090090=","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.944Z"}
{"line":"atscalaconcurrentFutureanonfunflatMap1applyFuturescala251snowplow+stream+collector+09009","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.944Z"}
{"line":"atscalaconcurrentFutureanonfunflatMap1applyFuturescala249snowplow+stream+collector+09009","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.945Z"}
{"line":"atscalaconcurrentimplCallbackRunnablerunPromisescala32snowplow+stream+collector+09009w==","errors":[{"level":"error","message":"Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 2 bytes, but only got 0 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)"}],"failure_tstamp":"2017-07-24T07:21:48.945Z"}

Please help me how to resolve the above issue. Sorry for the late reply in response

4

From the below command via pipeline

2-collectors/scala-stream-collector/target/scala-2.10/snowplow-stream-collector-0.9.0 --config 2-collectors/scala-stream-collector/target/scala-2.10/my.conf | 3-enrich/stream-enrich/target/scala-2.10/snowplow-stream-enrich-0.10.0 --config 3-enrich/stream-enrich/target/scala-2.10/config/my.conf --resolver file:3-enrich/stream-enrich/target/scala-2.10/config/iglu_resolver.json --enrichments file:3-enrich/stream-enrich/target/scala-2.10/config/enrichments

I used to get the following error I couldn’t figure it out what it indicates. Following error that is generating was

{“line”:“”,“errors”:[{“level”:“error”,“message”:“Error deserializing raw event: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes. (This is often indicative of an internal error on the server side. Please check your server logs.)”}],“failure_tstamp”:“2017-07-24T06:07:49.944Z”}

I Thank you in advance for your reply…

5

The other file is also generated known as “ip_geo” file.
This error was generated because of CorruptedThriftLinesSpec.scala in coding part of com.snowplowanalytics.snowplow.enrich.hadoop and here is an link CorruptedThriftLinesSpec.scala

@alex will you predict any changes has to be done.

6

@alex @josh @alex @manju

Hi Folks,
Will some one explain me about how to run this snowplow project or atleast resolve the issues in running the snowplow project in standalone system for the newbies.

That would be greatly appreciated.
Thanking You,
Nishanth J @nishanth