Documentation on raw log JSON?

For engineers Tracking SDKs
1

I found this to describe the model in which your events end up in Redshift at the end of the pipeline, but is there any documentation for the format that they’re stored in directly from the collector?

For example something to tell me what all these fields mean, some are obvious, but others less so:

{
   "schema":"iglu:com.snowplowanalytics.snowplow/payload_data/jsonschema/1-0-3",
   "data":[
      {
         "e":"ue",
         "ue_pr":"{\"schema\":\"iglu:com.snowplowanalytics.snowplow/unstruct_event/jsonschema/1-0-0\",\"data\":{\"group\":\"rm.search\",\"name\":\"searchParams\",\"program\":\"lifemiles\",\"checkIn\":\"05/08/2016\",\"checkOut\":\"05/18/2016\",\"query\":\"NY, United States\",\"regionId\":6837,\"latitude\":40.7127837,\"longitude\":-74.00594130000002,\"locationType\":\"CITY\",\"rooms\":1,\"currency\":\"USD\"}}",
         "ue_n":"searchParams",
         "ue_g":"rm.search",
         "tv":"js-2.5.3-rm-custom",
         "tna":"cf",
         "aid":"www",
         "p":"web",
         "tz":"America/Bogota",
         "lang":"es-CO",
         "cs":"utf-8",
         "f_java":"1",
         "res":"1242x698",
         "cd":"24",
         "cookie":"1",
         "eid":"d1e64ab3-e661-4c5d-b621-c56026a6853a",
         "dtm":"1459832455714",
         "co":"{\"schema\":\"iglu:com.snowplowanalytics.snowplow/contexts/jsonschema/1-0-1\",\"data\":[]}",
         "vp":"1242x621",
         "ds":"1242x621",
         "vid":"2",
         "sid":"b91a511b-5e86-4b57-89f3-39951e522abe",
         "duid":"40ac816a870205ad",
         "fp":"1621115501",
         "rmid":"F89524A94CBA91CE408D22884EE398DA-n1",
         "refr":"https://www.rocketmiles.com/searchregion=52993&query=Bogot%C3%A1%20-%20Bogota,%20Colombia&latitude=4.710988599999999&longitude=-74.072092&locationType=CITY&checkIn=05%2F08%2F2016&checkOut=05%2F11%2F2016&program=lifemiles&guests=2&rooms=1&currency=USD",
         "url":"https://www.rocketmiles.com/search?region=52993&query=Bogot%C3%A1%20-%20Bogota,%20Colombia&latitude=4.710988599999999&longitude=-74.072092&locationType=CITY&checkIn=05%2F08%2F2016&checkOut=05%2F18%2F2016&program=lifemiles&guests=2&rooms=1&currency=USD"
      }
   ]
}
2

Hi @dyerw,

Please, check out the wiki pages “Collector Logging Formats” and “Snowplow Tracker Protocol”. Is it what you were looking for?

Regards,
Ihor

1 Like
3

The Snowplow Tracker Protocol is what I was looking for! Thanks!