Get Error In Collector Config

Roadmap Questions
1

I am trying to set up snoplow as github user guide on my own computer . But get an error!

running command:
./snowplow-stream-collector-0.9.0 --config collector.conf

my config:

collector {
  interface = "0.0.0.0"
  port = 80
  production = true

  p3p {
    policyref = "/w3c/p3p.xml"
    CP = "NOI DSP COR NID PSA OUR IND COM NAV STA"
  }

  cookie {
    enabled = false
    expiration = 0
  }

  sink {
    enabled = "kinesis"

    kinesis {
      thread-pool-size: 10
      aws {
        access-key: "iam"
        secret-key: "iam"
      }

      stream {
        region: "us-east-1"
        good: "snowplow_raw"
        bad: "snowplow_raw_bad"
      }

      backoffPolicy: {
        minBackoff: 3000 # 3 seconds
        maxBackoff: 600000 # 5 minutes
      }

      buffer: {
        byte-limit: 4000000 # 4MB
        record-limit: 500 # 500 records
        time-limit: 60000 # 1 minute
      }
    }
  }
}

akka {
  loglevel = OFF
  loggers = ["akka.event.slf4j.Slf4jLogger"]
}

spray.can.server {
  remote-address-header = on

  uri-parsing-mode = relaxed
  raw-request-uri-header = on

  parsing {
    max-uri-length = 32768
  }
}

Error message:

Exception in thread "main" com.typesafe.config.ConfigException$Missing: No configuration setting found for key 'kafka'
	at com.typesafe.config.impl.SimpleConfig.findKey(SimpleConfig.java:124)
	at com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:145)
	at com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:159)
	at com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:164)
	at com.typesafe.config.impl.SimpleConfig.getObject(SimpleConfig.java:218)
	at com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:224)
	at com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:33)
	at com.snowplowanalytics.snowplow.collectors.scalastream.CollectorConfig.<init>(ScalaCollectorApp.scala:203)
	at com.snowplowanalytics.snowplow.collectors.scalastream.ScalaCollector$delayedInit$body.apply(ScalaCollectorApp.scala:81)
	at scala.Function0$class.apply$mcV$sp(Function0.scala:40)
	at scala.runtime.Abs`Preformatted text`tractFunction0.apply$mcV$sp(AbstractFunction0.scala:12)
	at scala.App$$anonfun$main$1.apply(App.scala:71)
	at scala.App$$anonfun$main$1.apply(App.scala:71)
	at scala.collection.immutable.List.foreach(List.scala:318)
	at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:32)
	at scala.App$class.main(App.scala:71)
	at com.snowplowanalytics.snowplow.collectors.scalastream.ScalaCollector$.main(ScalaCollectorApp.scala:50)
	at com.snowplowanalytics.snowplow.collectors.scalastream.ScalaCollector.main(ScalaCollectorApp.scala)

Is someone know this?

2

It looks like you’re missing the kafka part of your configuration. Even if you’re sink is Kinesis you’ll still need kafka as part of the HOCON configuration file.

3

Thanks a lot. I will try again