Hello,
I’m currently using enrich stream to read data from collector in real time and pipe the enriched output to a file. However, if I try to load the enriched events to Redsifht via COPY, it errors out because the tab separated values in events file are not aligned with events table.
Could you tell me if this is this expected?
The stream enrich version I’m using is - > snowplow-stream-enrich-0.10.0
Here’s a screenshot of the “stl_load_errors” table in Redshift -
Here’s one of the event generated by stream enrich that errors out -
Everest QA web 2017-05-08 22:03:56.338 2017-05-08 22:03:53.995 2017-05-08 22:03:53.570 transaction 67cb2fec-35fa-4e53-9530-cea6dfb0e366 cf js-2.7.0 ssc-0.9.0-kinesis kinesis-0.10.0-common-0.24.0 test@test.com 66.
234.199.33 3258001896 93036876-3a0c-4436-a47d-e0934b4f7ecb 4 543da39b-c8cb-4347-8195-49bfebfe352f US CA Pittsburg 94565 38.005096 -121.8387 California https://ccstore-z01a.oracleoutsourcing
.com/confirmation/7f822ae9-2a3b-4704-b184-ee265ca24943 https://ccstore-z01a.oracleoutsourcing.com/pirana-descender/product/checkout?url=pirana-descender/product/1462 https ccstore-z01a.oracleoutsourcing.com 80 /confirmation/7f822ae9-2a3b-4704-b184-ee2
65ca24943 https ccstore-z01a.oracleoutsourcing.com 80 /pirana-descender/product/checkout url=pirana-descender/product/1462 internal {"schema":"iglu:com.snowplow
analytics.snowplow/contexts/jsonschema/1-0-0","data":[{"schema":"iglu:com.google.analytics/cookies/jsonschema/1-0-0","data":{}},{"schema":"iglu:com.snowplowanalytics.snowplow/geolocation_context/jsonschema/1-1-0","data":{"latitude":37.9300095,"longitude":-122.03074760000001,
"latitudeLongitudeAccuracy":20,"altitude":null,"altitudeAccuracy":null,"bearing":null,"speed":null,"timestamp":1494280931508}},{"schema":"iglu:com.snowplowanalytics.snowplow/web_page/jsonschema/1-0-0","data":{"id":"c7285743-e180-4182-a16b-d4a287d8ac19"}},{"schema":"iglu:org.
w3/PerformanceTiming/jsonschema/1-0-0","data":{"navigationStart":1494280924946,"unloadEventStart":1494280925085,"unloadEventEnd":1494280925085,"redirectStart":0,"redirectEnd":0,"fetchStart":1494280924947,"domainLookupStart":1494280924947,"domainLookupEnd":1494280924947,"conn
ectStart":1494280924947,"connectEnd":1494280924947,"secureConnectionStart":0,"requestStart":1494280924955,"responseStart":1494280925082,"responseEnd":1494280925083,"domLoading":1494280925098,"domInteractive":1494280925553,"domContentLoadedEventStart":1494280925553,"domConten
tLoadedEventEnd":1494280925555,"domComplete":1494280925555,"loadEventStart":1494280925555,"loadEventEnd":1494280925556,"chromeFirstPaint":1494280925736}}]} o100516 Everest - Outdoor Gears and Apparel 37.95 0 10
Walnut Creek CA US Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36 Chrome Chrome 57.0.2987.133
Browser WEBKIT en-US 1 1 0 0 0 0 0 0 0 1 24 848 681 Mac OS X Mac OS X Apple Inc. America/Los_Angeles Computer 0 1680 1050 UTF-8 833 1305 USD
America/Los_Angeles 2017-05-08 22:03:53.960 {"schema":"iglu:com.snowplowanalytics.snowplow/contexts/jsonschema/1-0-1","data":[{"schema":"iglu:com.snowplowanalytics.snowplow/ua_parser_
context/jsonschema/1-0-0","data":{"useragentFamily":"Chrome","useragentMajor":"57","useragentMinor":"0","useragentPatch":"2987","useragentVersion":"Chrome 57.0.2987","osFamily":"Mac OS X","osMajor":"10","osMinor":"12","osPatch":"4","osPatchMinor":null,"osVersion":"Mac OS X 1
0.12.4","deviceFamily":"Other"}},{"schema":"iglu:org.ietf/http_cookie/jsonschema/1-0-0","data":{"name":"sp","value":"543da39b-c8cb-4347-8195-49bfebfe352f"}}]} a08d055a-9063-4f29-865e-2bbc9714388b 2017-05-08 22:03:53.605 com.snowplowanalytics.snowplow transaction j
sonschema 1-0-0 66b6557b0252cd64f3bea029de4a8a9b
Thanks