Issue reading enriched data thrift

Thanks for the answer @mike!

I’m trying to work with the TSV, but I’m having some troubles:

  • It seems that there is lots of “empty columns” (\t\t)
  • How can I know which data it which? What are the columns names

Here’s an example of a row, its a page view for www.pv-test.com generate via ruby tracker, locally :

data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data data
ID_test srv 2017-08-11 18:22:40.369 2017-08-11 18:20:12.495 2017-08-11 18:20:12.010 page_view ea7ef03e-a75f-4250-a28b-918d3bdb149e namespace rb-0.6.0 ssc-0.9.0-kinesis kinesis-0.10.0-common-0.24.0 172.18.0.1 60e6512b-cab2-4b11-b107-40bbb15f24bf http://www.pv-test.com http www.pv-test.com 80 Ruby Unknown Unknown unknown OTHER Unknown Unknown Other Unknown 0 2017-08-11 18:20:12.493 {“schema”:“iglu:com.snowplowanalytics.snowplow/contexts/jsonschema/1-0-1”,“data”:[{“schema”:“iglu:com.snowplowanalytics.snowplow/ua_parser_context/jsonschema/1-0-0”,“data”:{“useragentFamily”:“Other”,“useragentMajor”:null,“useragentMinor”:null,“useragentPatch”:null,“useragentVersion”:“Other”,“osFamily”:“Other”,“osMajor”:null,“osMinor”:null,“osPatch”:null,“osPatchMinor”:null,“osVersion”:“Other”,“deviceFamily”:“Other”}}]} 2017-08-11 18:20:12.012 com.snowplowanalytics.snowplow page_view jsonschema 1-0-0

raw:

ID_test srv 2017-08-11 18:22:40.369 2017-08-11 18:20:12.495 2017-08-11 18:20:12.010 page_view ea7ef03e-a75f-4250-a28b-918d3bdb149e namespace rb-0.6.0 ssc-0.9.0-kinesis kinesis-0.10.0-common-0.24.0 172.18.0.1 60e6512b-cab2-4b11-b107-40bbb15f24bf http://www.pv-test.com http www.pv-test.com 80 Ruby Unknown Unknown unknown OTHER Unknown Unknown Other Unknown 0 2017-08-11 18:20:12.493 {"schema":"iglu:com.snowplowanalytics.snowplow/contexts/jsonschema/1-0-1","data":[{"schema":"iglu:com.snowplowanalytics.snowplow/ua_parser_context/jsonschema/1-0-0","data":{"useragentFamily":"Other","useragentMajor":null,"useragentMinor":null,"useragentPatch":null,"useragentVersion":"Other","osFamily":"Other","osMajor":null,"osMinor":null,"osPatch":null,"osPatchMinor":null,"osVersion":"Other","deviceFamily":"Other"}}]} 2017-08-11 18:20:12.012 com.snowplowanalytics.snowplow page_view jsonschema 1-0-0 3baf6fb871880d77b2ebcd3866bbc05b 

How can I know what to put in the place of data?

Many Thanks,
Caio