TSV Column Names? (Enrich result)

1

Can someone point me to the column names of the enriched TSV format? I cannot seem to find it anywhere. It’s the result of Kafka Stream Enrich with some enrichers.

This is what I want to parse:

test	web	2019-10-30 17:30:34.302	2019-10-30 17:30:29.169	2019-10-30 17:30:31.755	page_view	b173ab5d-54c7-4e31-8a25-d28c658ee73d		cf	js-2.11.0	ssc-0.16.0-kafka	stream-enrich-0.21.0-common-0.37.0		89.31.99.x	1776775914	e3201a9a-2baf-4a22-8f80-08f7b9538ecd	8	2c094c4f-d642-4f5e-8f78-93ba4a035a05	NL				52.3824	4.8995						https://example.com/test.php	My Website with Snowplow Collector		https	example.com	443	/test.php																																										Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.121 Safari/537.36 Vivaldi/2.8.1664.44						en-US	1	0	0	0	0	0	0	0	0	1	24	1600	409				Europe/Berlin			1280	720	UTF-8	1600	409								Europe/Amsterdam				2019-10-30 17:30:31.759			{"schema":"iglu:com.snowplowanalytics.snowplow/contexts/jsonschema/1-0-1","data":[{"schema":"iglu:nl.basjes/yauaa_context/jsonschema/1-0-0","data":{"deviceBrand":"Unknown","deviceName":"Desktop","layoutEngineNameVersion":"Blink 77.0","operatingSystemNameVersion":"Windows 7","layoutEngineNameVersionMajor":"Blink 77","operatingSystemName":"Windows NT","agentVersionMajor":"2","layoutEngineVersionMajor":"77","deviceClass":"Desktop","agentNameVersionMajor":"Vivaldi 2","deviceCpuBits":"64","operatingSystemClass":"Desktop","layoutEngineName":"Blink","agentName":"Vivaldi","agentVersion":"2.8.1664.44","layoutEngineClass":"Browser","agentNameVersion":"Vivaldi 2.8.1664.44","operatingSystemVersion":"7","deviceCpu":"Intel x86_64","agentClass":"Browser","layoutEngineVersion":"77.0"}}]}	8142b300-4607-4bd1-95e3-bb54b3563861	2019-10-30 17:30:29.165	com.snowplowanalytics.snowplow	page_view	jsonschema	1-0-0	43e44f37a65e062c352fbad03e1f173b

I think the first two are:

appId,source

There are also empty fields (multiple tabs next to eachother), is there a way to find out what Snowplow is trying to put there and is not provided by the JavaScript tracker?

2

@MrMoronIV, you can look the TSV properties up in the actual code here.

3

Thank you, that did the trick!

4

Just to quickly add - if you’re aiming to parse the TSV event that Enrich outputs, you’re best off using one of our Analytics SDKs to do so. :slight_smile:

5

I’m trying to get enriched events into Druid, which seems to not be native supported. I have parsed the event successfully using Druid, but I still need to somehow flatten the derived_context json found in the TSV event.

I’m very close to having a Collector > Kafka > Enrich > Kafka > Druid setup, last thing is flattening the JSON :slight_smile: