"igluctl static push" doesn't create new column with non-breaking version

For data modelers & consumers Iglu
1

I am validating the quick start guide of snowplow for GCP. I see the issue when I push new non-breaking schema version.

Let’s say, the current jsonschema on pg is 1-0-1. I added 1 more field “utm_c” then “igluctl static push” the 1-0-2 version to pg. But on pg, there is no the column “utm_c”, neither after I post 1-0-2 event by web tracker.

Is there anything I missed?

1-0-1

{
    "$schema": "http://iglucentral.com/schemas/com.snowplowanalytics.self-desc/schema/jsonschema/1-0-0#",
    "description": "Schema for a button click event",
    "self": {
        "vendor": "com.snowplowanalytics",
        "name": "button_click_2",
        "format": "jsonschema",
        "version": "1-0-1"
    },
    "type": "object",
    "properties": {
        "id": {
            "type": "string",
            "minLength": 1
        },
        "target": {
            "type": "string"
        },
        "content": {
            "type": "string"
        },
        "utm_a": {
            "type": "string"
        },
        "utm_b": {
            "type": "string"
        }
    },
    "required": ["id"],
    "additionalProperties": false
}

1-0-2

{
    "$schema": "http://iglucentral.com/schemas/com.snowplowanalytics.self-desc/schema/jsonschema/1-0-0#",
    "description": "Schema for a button click event",
    "self": {
        "vendor": "com.snowplowanalytics",
        "name": "button_click_2",
        "format": "jsonschema",
        "version": "1-0-2"
    },
    "type": "object",
    "properties": {
        "id": {
            "type": "string",
            "minLength": 1
        },
        "target": {
            "type": "string"
        },
        "content": {
            "type": "string"
        },
        "utm_a": {
            "type": "string"
        },
        "utm_b": {
            "type": "string"
        },
        "utm_c": {
            "type": "string"
        }
    },
    "required": ["id"],
    "additionalProperties": false
}
2

Hey @Rick_Yang ,

May I ask which table you are querying exactly ?

3

select * from atomic.com_snowplowanalytics_button_click_2_1

The table schema is below.

Screen Shot 2022-01-04 at 10.08.38 AM
Screen Shot 2022-01-04 at 10.08.38 AM644×512 11.4 KB

What I expect is the table has utm_a, utm_b, utm_c. But you can see utm_c is not there.

4

Hi @Rick_Yang
Welcome to the Snowplow Community!
Cheers,
Eddie

5

Just to confirm - have you sent a test event for button_click_2 into the pipeline? This should force the Postgres loader to validate, fetch and mutate the table and then leave a comment with the latest schema version on it.