Download folder in config.yml for Postgres

For engineers Storage targets
1

Sorry for the incredibly basic question.

We’re in the process of setting up Snowplow using Clojure Collector -> EMREtlRunner -> Postgres Storage.

So far we’ve got logs being collected, and those being moved, enriched etc on our S3 instances on AWS. We’d like to store the data in a postgres database to have a look at what’s going on. We’ve set up a target postgres.json.

My question is…

In config.yml there is a line that says

storage:
download:
folder:

Should the folder be a S3 located folder, or a folder local to where the scripts that are running?

Thanks

2

It should be a local directory where you can download snowplow event files to load them into your local postgres server. If you are using the latest snowplow release, take a look here how to configure your storage targets.