Interpreting errors in bad events


#1

I could use some help interpreting these errors that I am seeing in bad events that are coming out of the batch pipeline (EMR ETL Runner), here is a snippet of the error

{"line":"2016-11-08\t12:46:04\tAMS1\t480\t41.190.14.251\tGET\td1itczir7g7la8.cloudfront.net\t/i\t200\thttp://www.naturallycurly.com/curlreading/home/3-reasons-why-4c-hair-is-different-than-other-texture-types/?utm_source=cm_newsletter&utm_medium=email&utm_campaign=20161107_coily&_hsenc=p2ANqtz--veXhnzczLv6vPtiNP0t1XUdqMd08Mn0Lv7mNaTyRmzdM4xTd-R2pUv0xD9tpwvG2i4MwxOKwKXmRlRXhvE8OYcDx-nQ&_hsmi=37196888\tMozilla/5.0%2520(iPhone;%2520CPU%2520iPhone%2520OS%252010_0_1%2520like%2520Mac%2520OS%2520X)%2520AppleWebKit/602.1.50%2520(KHTML,%2520like%2520Gecko)%2520Version/10.0%2520Mobile/14A403%2520Safari/602.1\tstm=1478609163955&e=pp&url=http%253A%252F%252Fwww.naturallycurly.com%252Fcurlreading%252Fhome%252F3-reasons-why-4c-hair-is-different-than-other-texture-types%252F%253Futm_source%253Dcm_newsletter%2526utm_medium%253Demail%2526utm_campaign%253D20161107_coily%2526_hsenc%253Dp2ANqtz--veXhnzczLv6vPtiNP0t1XUdqMd08Mn0Lv7mNaTyRmzdM4xTd-R2pUv0xD9tpwvG2i4MwxOKwKXmRlRXhvE8OYcDx-nQ%2526_hsmi%253D37196888&page=3%2520Reasons%2520Why%25204c%2520Hair%2520Is%2520Different%2520Than%2520Other%2520Texture%2520Types&pp_mix=0&pp_max=0&pp_miy=2009&pp_may=2121&tv=js-2.6.1&tna=cf&aid=naturally-curly-v2&p=web&tz=Africa%252FLagos&lang=en-us&cs=UTF-8&res=375x667&cd=32&cookie=1&eid=abce38a8-d638-4d5f-9e25-d84137a767df&dtm=1478609163952&vp=375x628&ds=390x8383&vid=2&sid=e276e32e-aa45-41ce-871c-75d6c986d1b2&duid=e242945f-ce30-4cec-8004-135955b8809a&fp=4142137647&cx=eyJzY2hlbWEiOiJpZ2x1OmNvbS5zbm93cGxvd2FuYWx5dGljcy5zbm93cGxvdy9jb250ZXh0cy9qc29uc2NoZW1hLzEtMC0wIiwiZGF0YSI6W3sic2NoZW1hIjoiaWdsdTpjb20uc25vd3Bsb3dhbmFseXRpY3Muc25vd3Bsb3cvd2ViX3BhZ2UvanNvbnNjaGVtYS8xLTAtMCIsImRhdGEiOnsiaWQiOiI4NWM3ZDIxNS01M2U1LTQ2MzEtYmZmMS1kZTg3MWU1MDQyZTcifX0seyJzY2hlbWEiOiJpZ2x1OmNvbS5vbmVzcG90L3BhZ2V2aWV3LWNvbnRleHQvanNvbi1zY2hlbWEvMi0wLTAiLCJkYXRhIjp7ImNhbm9uaWNhbF9saW5rIjoiaHR0cDovL3d3dy5uYXR1cmFsbHljdXJseS5jb20vY3VybHJlYWRpbmcvaG9tZS8zLXJlYXNvbnMtd2h5LTRjLWhhaXItaXMtZGlmZmVyZW50LXRoYW4tb3RoZXItdGV4dHVyZS10eXBlcy8ifX0seyJzY2hlbWEiOiJpZ2x1OmNvbS5vbmVzcG90L3VzZXItaWQvanNvbi1zY2hlbWEvMS0wLTAiLCJkYXRhIjp7InNvdXJjZSI6Im9uZXNwb3RfZmlyc3RfcGFydHlfaWQiLCJ1c2VyX2lkIjoiUEp1QnQyT0JIRTJHZ296T09aQndRUSJ9fSx7InNjaGVtYSI6ImlnbHU6Y29tLm9uZXNwb3QvZXhwZXJpbWVudC9qc29uLXNjaGVtYS8xLTAtMCIsImRhdGEiOnsiZXhwZXJpbWVudCI6IjIwMTYtMTAtMjEiLCJleHBlcmltZW50X3R5cGUiOiJvbnNpdGUiLCJyZWdpb24iOiJibG9nIiwidmFyaWFudCI6InJpZ2h0LXJhaWwtNS1yZWNzIn19LHsic2NoZW1hIjoiaWdsdTpjb20ub25lc3BvdC9leHBlcmltZW50L2pzb24tc2NoZW1hLzEtMC0wIiwiZGF0YSI6eyJleHBlcmltZW50IjoiMjAxNi0xMC0yMSIsImV4cGVyaW1lbnRfdHlwZSI6Im9uc2l0ZSIsInJlZ2lvbiI6InByb2R1Y3RzIiwidmFyaWFudCI6ImJhc2VsaW5lIn19LHsic2NoZW1hIjoiaWdsdTpjb20ub25lc3BvdC9vbnNpdGUtdW5pdC9qc29uLXNjaGVtYS8xLTAtMCIsImRhdGEiOnsidW5pdF9pZCI6InJpZ2h0LXJhaWwtdW5pdC\t-\tHit\tEB7dy9PPZvjdG3ZwQh8J7-kvmWXBVGbsRpc5qOr14-TpT6urpWqt4g==\td1itczir7g7la8.cloudfront.net\thttp\t2692\t0.005\t-\t-\t-\tHit\tHTTP/1.1","errors":[{"level":"error","message":"Field [cx]: invalid JSON [{\"schema\":\"iglu:com.snowplowanalytics.snowplow/contexts/jsonschema/1-0-0\",\"data\":[{\"schema\":\"iglu:com.snowplowanalytics.snowplow/web_page/jsonschema/1-0-0\",\"data\":{\"id\":\"85c7d215-53e5-4631-bff1-de871e5042e7\"}},{\"schema\":\"iglu:com.onespot/pageview-context/json-schema/2-0-0\",\"data\":{\"canonical_link\":\"http://www.naturallycurly.com/curlreading/home/3-reasons-why-4c-hair-is-different-than-other-texture-types/\"}},{\"schema\":\"iglu:com.onespot/user-id/json-schema/1-0-0\",\"data\":{\"source\":\"onespot_first_party_id\",\"user_id\":\"PJuBt2OBHE2GgozOOZBwQQ\"}},{\"schema\":\"iglu:com.onespot/experiment/json-schema/1-0-0\",\"data\":{\"experiment\":\"2016-10-21\",\"experiment_type\":\"onsite\",\"region\":\"blog\",\"variant\":\"right-rail-5-recs\"}},{\"schema\":\"iglu:com.onespot/experiment/json-schema/1-0-0\",\"data\":{\"experiment\":\"2016-10-21\",\"experiment_type\":\"onsite\",\"region\":\"products\",\"variant\":\"baseline\"}},{\"schema\":\"iglu:com.onespot/onsite-unit/json-schema/1-0-0\",\"data\":{\"unit_id\":\"right-rail-unit] with parsing error: Unexpected end-of-input: was expecting closing quote for a string value at [Source: {\"schema\":\"iglu:com.snowplowanalytics.snowplow/contexts/jsonschema/1-0-0\",\"data\":[{\"schema\":\"iglu:com.snowplowanalytics.snowplow/web_page/jsonschema/1-0-0\",\"data\":{\"id\":\"85c7d215-53e5-4631-bff1-de871e5042e7\"}},{\"schema\":\"iglu:com.onespot/pageview-context/json-schema/2-0-0\",\"data\":{\"canonical_link\":\"http://www.naturallycurly.com/curlreading/home/3-reasons-why-4c-hair-is-different-than-other-texture-types/\"}},{\"schema\":\"iglu:com.onespot/user-id/json-schema/1-0-0\",\"data\":{\"source\":\"onespot_first_party_id\",\"user_id\":\"PJuBt2OBHE2GgozOOZBwQQ\"}},{\"schema\":\"iglu:com.onespot/experiment/json-schema/1-0-0\",\"data\":{\"experiment\":\"2016-10-21\",\"experiment_type\":\"onsite\",\"region\":\"blog\",\"variant\":\"right-rail-5-recs\"}},{\"schema\":\"iglu:com.onespot/experiment/json-schema/1-0-0\",\"data\":{\"experiment\":\"2016-10-21\",\"experiment_type\":\"onsite\",\"region\":\"products\",\"variant\":\"baseline\"}},{\"schema\":\"iglu:com.onespot/onsite-unit/json-schema/1-0-0\",\"data\":{\"unit_id\":\"right-rail-unit; line: 1, column: 1935]"}],"failure_tstamp":"2016-11-09T03:53:58.442Z"}

we did recently turn on performance timing context so it might be related to this topic:
http://discourse.snowplowanalytics.com/t/events-going-to-bad-bucket/724/2


#2

Hello @ryanrozich,

No, that’s a different issue. You’re sending corrupted contexts (invalid JSON) along with your events, because your query string was truncated by user’s browser.
Problem is that this particular event was sent from iPhone Safari using GET-request and it truncates querystrings longer than 2KB. We recommend you to use POST requests if you have many contexts attached.


#3

Thanks @anton!