upgraded to latest stream enrich (snowplow-stream-enrich-kinesis-0.19.1.jar) but still running on older snowplow-kinesis-s3-0.4.1. anyone know why we are getting 3 chars for geo_region instead of 2 when upgrading? i checked the latest atomic.events master schema and still says geo region should be 2 chars. batch runs fine and shows up as geo_region 2 when done.
userid | 118
slice | 4
tbl | 5451829
starttime | 2018-10-01 12:29:28.002229
session | 4902
query | 27746842
filename | s3://ga-snowplow-production/snowplow-enriched-intraday/in/2018-10-01-49588598374129293789694283554165351853830598362795081826-49588598374129293789694283554599356223072250236514599010.gz
line_number | 1
colname | geo_region
type | char
col_length | 2
position | 320
raw_line | WebSiteOld web 2018-10-01 12:28:46.320 2018-10-01 12:19:52.750 2018-10-01 12:19:52.629 unstruct dcf0f00e-5915-49b2-8ead-e248f7ae0cba cf-hosted-v2.8.2 js-2.8.2 ssc-0.14.0-kinesis stream-enrich-0.19.1-common-0.35.0 XX.XX.XX.XX 455090429 bb3254c1-e05e-4f6c-a9d6-0a20154396da 59 c3fbe5b1-c579-4dcf-8e05-6ab0b561a8d5 RU MOW Moscow 102421 55.7522 37.6156 Moscow https://generalassemb.ly/education/user-experience-design https://generalassemb.ly/education/user-experience-design-immersive https generalassemb.ly 443 /education/user-experience-design https generalassemb.ly 443 /education/user-experience-design-immersive {“schema”:“iglu:com.snowplowanalytics.snowplow/contexts/jsonschema/1-0-0”,“data”:[{“schema”:“iglu:com.google.analytics/cookies/jsonschema/1-0-0”,“data”:{"__utma":“63617721.1790239682.1537304111.1537378654.1537378654.1”,"__utmc":“63617721”,"__utmv":“63617721.|1=Login Status=guest=1^2=Metro=london=1”,"__utmz":“63617721.1537378654.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none)”,"_ga":"
raw_field_value | MOW
err_code | 1204
err_reason | Char length exceeds DDL length
using new ip_lookups enrichment
[root@ip-XX-XX-XX-XX enrichments]# more ip_lookups.json
{
“schema”: “iglu:com.snowplowanalytics.snowplow/ip_lookups/jsonschema/2-0-0”,
"data": {
"name": "ip_lookups",
"vendor": "com.snowplowanalytics.snowplow",
"enabled": true,
"parameters": {
"geo": {
"database": "GeoLite2-City.mmdb",
"uri": "http://snowplow-hosted-assets.s3.amazonaws.com/third-party/maxmind"
}
}
}
}