Shredder not producing shredded-tsv

For engineers
2

Hi @jeroen.v,

Thanks for the kind words!

I think your problem is that blacklistTabular is either missing or null, which means pre-R32-behavior or JSON everywhere.

If you populate blacklistTabular with schema criterions that you want to shred into JSON - everything not listed there with be shredded into TSV. So for example if you have schemas:

  • igiu:com.acme/event_one/jsonschema/1-0-0
  • igiu:com.acme/event_one/jsonschema/2-0-0
  • igiu:com.acme/event_two/jsonschema/1-0-0

And you want event_two to be shredded into TSV, your config should look like following:

{
  "blacklistTabular": [
    "igiu:com.acme/event_one/jsonschema/1-*-*",
    "igiu:com.acme/event_one/jsonschema/2-*-*"
  ]
}

That distinction between null (legacy) and [] (all in-TSV) is a bit confusing. Recently we released R35 with hopefully more sensible configuration and many other improvements, so I can remcommend you to have a look at it.