RFC: making the Snowplow pipeline real-time end-to-end and deprecating support for batch processing modules

The broader solution is probably to run those jobs more regularly and look at how you provision them - not my area so I can’t say much about it.

However I do think it’s worth mentioning that if you’re concerned about page pings & processing volumes, the latest version of the JS tracker lets you use a callback to aggregate them client-side.

3 Likes