BigQuery Loader Jar Assembly

For engineers
1

Hi,

I was trying to create a jar file of the bigquery loader using sbt as I couldn’t find it on the github page.
But I am facing the following issue

[error] 48 errors were encountered during merge
[error] java.lang.RuntimeException: deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/auth.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/auth.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/backend.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/backend.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/billing.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/billing.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/config_change.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/config_change.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/consumer.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/consumer.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/context.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/context.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/control.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/control.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/distribution.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/distribution.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/documentation.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/documentation.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/endpoint.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/endpoint.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/http.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/http.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/httpbody.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/httpbody.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/label.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/label.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/log.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/log.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/logging.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/logging.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/metric.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/metric.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/monitored_resource.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/monitored_resource.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/monitoring.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/monitoring.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/quota.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/quota.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/service.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/service.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/source_info.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/source_info.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/system_parameter.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/system_parameter.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/usage.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/usage.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/cloud/audit/audit_log.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/cloud/audit/audit_log.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/logging/type/http_request.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/logging/type/http_request.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/logging/type/log_severity.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/logging/type/log_severity.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/longrunning/operations.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/longrunning/operations.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.13.0/protobuf-java-3.13.0.jar:google/protobuf/any.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-calcite-1_20_0/0.1/beam-vendor-calcite-1_20_0-0.1.jar:google/protobuf/any.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/protobuf/any.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.13.0/protobuf-java-3.13.0.jar:google/protobuf/compiler/plugin.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-calcite-1_20_0/0.1/beam-vendor-calcite-1_20_0-0.1.jar:google/protobuf/compiler/plugin.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/protobuf/compiler/plugin.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.13.0/protobuf-java-3.13.0.jar:google/protobuf/descriptor.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-calcite-1_20_0/0.1/beam-vendor-calcite-1_20_0-0.1.jar:google/protobuf/descriptor.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/protobuf/descriptor.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.13.0/protobuf-java-3.13.0.jar:google/protobuf/duration.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-calcite-1_20_0/0.1/beam-vendor-calcite-1_20_0-0.1.jar:google/protobuf/duration.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/protobuf/duration.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.13.0/protobuf-java-3.13.0.jar:google/protobuf/field_mask.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-calcite-1_20_0/0.1/beam-vendor-calcite-1_20_0-0.1.jar:google/protobuf/field_mask.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/protobuf/field_mask.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.13.0/protobuf-java-3.13.0.jar:google/protobuf/struct.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-calcite-1_20_0/0.1/beam-vendor-calcite-1_20_0-0.1.jar:google/protobuf/struct.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/protobuf/struct.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.13.0/protobuf-java-3.13.0.jar:google/protobuf/timestamp.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-calcite-1_20_0/0.1/beam-vendor-calcite-1_20_0-0.1.jar:google/protobuf/timestamp.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/protobuf/timestamp.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.13.0/protobuf-java-3.13.0.jar:google/protobuf/type.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-calcite-1_20_0/0.1/beam-vendor-calcite-1_20_0-0.1.jar:google/protobuf/type.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/protobuf/type.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.13.0/protobuf-java-3.13.0.jar:google/protobuf/wrappers.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-calcite-1_20_0/0.1/beam-vendor-calcite-1_20_0-0.1.jar:google/protobuf/wrappers.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/protobuf/wrappers.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/rpc/code.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/rpc/code.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/rpc/error_details.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/rpc/error_details.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/rpc/status.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/rpc/status.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/type/color.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/type/color.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/type/date.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/type/date.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/type/dayofweek.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/type/dayofweek.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/type/latlng.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/type/latlng.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/type/money.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/type/money.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/type/postal_address.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/type/postal_address.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/type/timeofday.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/type/timeofday.proto
[error] deduplicate: different file contents found in the following:
[error] log4j.properties
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-sdks-java-extensions-sql/2.24.0/beam-sdks-java-extensions-sql-2.24.0.jar:log4j.properties
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-calcite-1_20_0/0.1/beam-vendor-calcite-1_20_0-0.1.jar:mozilla/public-suffix-list.txt
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/httpcomponents/httpclient/4.5.12/httpclient-4.5.12.jar:mozilla/public-suffix-list.txt
[error]         at sbtassembly.Assembly$.applyStrategies(Assembly.scala:161)
[error]         at sbtassembly.Assembly$.x$1$lzycompute$1(Assembly.scala:43)
[error]         at sbtassembly.Assembly$.x$1$1(Assembly.scala:41)
[error]         at sbtassembly.Assembly$.stratMapping$lzycompute$1(Assembly.scala:41)
[error]         at sbtassembly.Assembly$.stratMapping$1(Assembly.scala:41)
[error]         at sbtassembly.Assembly$.inputs$lzycompute$1(Assembly.scala:86)
[error]         at sbtassembly.Assembly$.inputs$1(Assembly.scala:76)
[error]         at sbtassembly.Assembly$.apply(Assembly.scala:103)
[error]         at sbtassembly.Assembly$.$anonfun$assemblyTask$1(Assembly.scala:278)
[error]         at scala.Function1.$anonfun$compose$1(Function1.scala:49)
[error]         at sbt.internal.util.$tilde$greater.$anonfun$$u2219$1(TypeFunctions.scala:62)
[error]         at sbt.std.Transform$$anon$4.work(Transform.scala:68)
[error]         at sbt.Execute.$anonfun$submit$2(Execute.scala:282)
[error]         at sbt.internal.util.ErrorHandling$.wideConvert(ErrorHandling.scala:23)
[error]         at sbt.Execute.work(Execute.scala:291)
[error]         at sbt.Execute.$anonfun$submit$1(Execute.scala:282)
[error]         at sbt.ConcurrentRestrictions$$anon$4.$anonfun$submitValid$1(ConcurrentRestrictions.scala:265)
[error]         at sbt.CompletionService$$anon$2.call(CompletionService.scala:64)
[error]         at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[error]         at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
[error]         at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[error]         at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[error]         at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[error]         at java.base/java.lang.Thread.run(Thread.java:829)
[error] (assembly) deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/auth.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/auth.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/backend.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/backend.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/billing.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/billing.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/config_change.proto
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/beam/beam-vendor-grpc-1_26_0/0.3/beam-vendor-grpc-1_26_0-0.3.jar:google/api/config_change.proto
[error] deduplicate: different file contents found in the following:
[error] /home/sivanandan_rendeddula/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/1.18.0/proto-google-common-protos-1.18.0.jar:google/api/consumer.proto
[error] 
.......

Could someone help me out?

Thank you!

2

Hey @siv ,

I assume you tried to assemble a jar for loader subproject. It is a dataflow job and we have an official docker image for that subproject.

For other subprojects (mutator, repeater, streamloader), we distribute fatjars as well as docker images.

Please let us know if you have further questions.

Kind regards.

1 Like
3

Hi @oguzhanunlu,

I’ve seen the docker image for the BQ loader but I wanted to get access to the jar if its available. Is it possible to create the jar for the BQ loader?

Thank you!

4

Hi @siv ,

It is not available officially but you can modify sbt-assembly plugin settings to build it yourself.

We are working on a streaming BQ Loader (streamloader subproject) and it comes with a fatjar if you don’t prefer docker.

Thanks.

1 Like
5

Got it! thank you @oguzhanunlu

1 Like