Getting the corresponding request of error 4xx logs

For engineers AWS real-time pipeline
1

Hi,

we are runnning a collector which writes data to an AWS Stream. In the logs multiple requests pop up looking similar to:

2016-09-21 15:44:15,481 WARN [lt-dispatcher-6] s.c.s.HttpServerConnection - Illegal request header: Illegal 'User-Agent' header: Invalid input '(', expected '\' or ')' (line 1, pos 69):

Can anyone help me to get the corresponding page request to this error Log to debug it?

Thanks for your help.

2

Hi @froehr,

If you are running whole realtime stack, analyse bad data stream. Most likely you would find raw requests there. I guess this is direct bot/spider request, not generated by tracker. I would not care. As long as the rate is constant/decreasing.