When i try to run
~/snowplow/2-collectors/scala-stream-collector$ sbt "project kinesis" assembly
I get error
Detail:
Java Version:
openjdk version “1.8.0_265”
OpenJDK Runtime Environment (build 1.8.0_265-8u265-b01-0+deb9u1-b01)
OpenJDK 64-Bit Server VM (build 25.265-b01, mixed mode)
Scala Version:
Scala code runner version 2.11.8 – Copyright 2002-2016, LAMP/EPFL
Sbt Version:
Getting org.scala-sbt sbt 0.13.7 …
This looks like you are trying to build the Scala Stream Collector? You shouldn’t need to compile it from source to use it.
I’d advise using the hosted assets, either the JAR file directly from our bintray repository or by using the docker images: https://docs.snowplowanalytics.com/docs/open-source-components-and-applications/hosted-assets/#2-2-scala-stream-collector-resources
so you mean i dont need to compile it ? Ok if i download from the hosted asset then i can put it anywhere inside scala-stream-collector? @PaulBoocock
You can download the jar file directly rather than compiling it yes. Then you need to run the jar file with a suitable configuration file.
Configruation information: https://docs.snowplowanalytics.com/docs/setup-snowplow-on-aws/setup-the-snowplow-collector/configure-the-scala-stream-collector/
Running the jar: https://docs.snowplowanalytics.com/docs/setup-snowplow-on-aws/setup-the-snowplow-collector/run-the-scala-stream-collector/
You’ll need to ensure the server you are running it on has Java Runtime Environment (JRE) 1.8 installed.
@PaulBoocock i have downloaded from hosted asset and configured my.conf. But i am confused in configuration. In the place of streams.good & streams.bad , i have used s3 bucket name. Is it correct? In streams.aws.accessKey & streams.aws.secretKey, i have used iam. So where should i put AWS IAM credentials?
The streams are your kinesis streams that you will need to configure in AWS.
The Scala Stream Collector (kinesis) writes to a kinesis stream, not directly into S3.
