Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Collector KafkaSink fail to send event #420

Open
AkhtemWays opened this issue Mar 28, 2024 · 0 comments
Open

Collector KafkaSink fail to send event #420

AkhtemWays opened this issue Mar 28, 2024 · 0 comments

Comments

@AkhtemWays
Copy link

AkhtemWays commented Mar 28, 2024

Hi,

We are having following errors in our prod deployment.

[scala-stream-collector-akka.actor.default-dispatcher-13] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 2233940 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-5] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 2233940 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-8] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 2234204 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-10] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 2976674 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-5] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 2976946 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-14] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 3719423 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-9] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 3719423 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-11] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 3719423 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-5] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 3719423 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-5] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 3719423 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-5] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 3719423 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-14] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 3719415 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-10] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 3719415 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-12] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 3719687 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-14] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 4462178 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-9] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 5205144 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-9] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 5204919 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-12] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 5947660 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-10] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 5947900 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-5] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 5947874 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-4] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 6690403 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-12] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 6690388 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-14] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 6690388 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-8] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 6690388 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
[scala-stream-collector-akka.actor.default-dispatcher-5] ERROR com.snowplowanalytics.snowplow.collectors.scalastream.sinks.KafkaSink - Sending event failed: The message is 6690388 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.

We tried many different configuration options for collector, and none seems to work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant