Quick Start Pipeline on GCP: PostgreSQL DB does not receive test data

Hello all,

I need help to build a snowplow pipeline in GCP.

Goal

My goal is to build a Snowplow pipeline using the Quickstart method in GCP.

Situation

So far I have used the Quick Start Installation Guide on GCP. The installation of the pipeline seems to work fine. When I send a test event according to the Send a test event guide, I get back HTTP/1.1 200 OK. However, when I try to query the generated test events according to the instructions Query your Postgres data , I get back 0 rows from the PostgreSQL DB.

I have so far tried, unfortunately unsuccessfully, to find log entries with the GCP Log Explorer and on the individual Compute Engine instances, to explain at which point in the pipeline the event data is lost.

What can I do or check to solve this problem?

Thank you in advance and best regards
Richard

Hi,

check you pub/sub subscriptions. Google Cloud Platform

Are there some unacked messages in sp-enrich-server subscription?

check logs (Google Cloud Platform)
any errors?

1 Like

Hi @riwi
Welcome to the Snowplow Community!.
Kind regards,
Eddie

1 Like

Hi Jiri,

thanks for helping.

Unacked Messages

I get one unacked message from a few hours ago:

At about that time, I actually sent some test events. I also sent test events again a few minutes ago. However, these do not show up in the chart.

Logs

Yes, we have two error logs from compute engine resources. After my research, I am not sure if these errors are related to the described problem. These are the error logs:

  1. Resource: sp-collector-server
    Method: v1.compute.instances.setMetadata
    Message: Supplied fingerprint does not match current metadata fingerprint.
  2. Resource: sp-enrich-server
    Method: v1.compute.instances.setMetadata
    Message: Supplied fingerprint does not match current metadata fingerprint.

That error sounds rather GCP-y rather than any Snowplow component error.

This is speculation at this stage, but Iā€™m curious if you have appropriate permissions in your GCP environment?

I assume the Quick Start terraform completed successfully?