Clojure Collector -> S3 log publishing fails


#1

Hi,

We have encountered a few cases where we experienced data loss due to Clojure collector not being able to publish logs to S3. Here are the error logs that we see:

2017-07-17 00:50:13,273 [WARNING] (27659 Thread-2) [util.py-92] [root util proxy_method] Unable to call publish_contents_from_file on target InstanceProfileS3Publisher: string longer than 2147483647 bytes
2017-07-17 00:50:13,417 [WARNING] (27659 Thread-2) [util.py-92] [root util proxy_method] Unable to call publish_contents_from_file on target SignedPostS3Publisher: Not enough information for a singed S3 post
2017-07-17 00:50:13,498 [INFO] (27659 Thread-2) [s3_tools.py-208] [root s3_tools _process_result] Received status code 403 with text: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>Access Denied</Message><RequestId>3B7636729DFFA7F7</RequestId><HostId>ScJJAIZyR25VmnShHVUO3+e6IB+HSA4g6yP68sjDsux4hCdyG3QBUwyg9mYLc0LqT7jL4558Ya0=</HostId></Error>
2017-07-17 00:50:13,498 [WARNING] (27659 Thread-2) [util.py-92] [root util proxy_method] Unable to call publish_contents_from_file on target AnonS3Publisher: 403 Client Error: Forbidden
2017-07-17 00:50:13,498 [ERROR] (27659 Thread-2) [upload_tools.py-525] [root upload_tools publish] Unable to publish log file /var/log/tomcat8/rotated/localhost_access_log.txt1500235298.gz to s3 at location resources/environments/logs/publish/e-3vymgtnbsi/i-06047e98fa5c2a6aa/_var_log_tomcat8_rotated_localhost_access_
log.txt1500235298.gz

Has anyone encountered these errors or happen to know their reasons?

Best,
Vytenis