Kafka cluster raise error when producing with ruby-kafkaWhy do Kafka consumers connect to zookeeper, and producers get metadata from brokers?Kafka hangs when Committing MessagesKafka not receiving message from external producerKafka producer issue: UnknownTopicOrPartitionExceptionKafka console producer can connect locally but not remotelyKafka Receives Messages But Fails To Add To Topic - With Setup Local Kafka VM and Minikube Kubernetes ClusterKafka Consumer not receiving messages if one node of the cluster is downSpring kafka and Kafka ClusterDisconnectException breaks the entire kafka clusterKafka Producer/Consumer reconnect after kafka node failure

Can you put ranks into knowledge skills that aren't class skills?

Is space radiation a risk for space film photography, and how is this prevented?

C# TCP server/client class

What is the reason behind water not falling from a bucket at the top of loop?

What is it exactly about flying a Flyboard across the English channel that made Zapata's thighs burn?

What percentage of campground outlets are GFCI or RCD protected?

Why does putting a dot after the URL remove login information?

Is it okay to use different fingers every time while playing a song on keyboard? Is it considered a bad practice?

Can I use my US callsign to transmit while in El Salvador?

Is there a way to improve my grade after graduation?

How do the surviving Asgardians get to Earth?

Broken bottom bracket?

How to call made-up data?

Formal mathematical definition of renormalization group flow

Why is the Vasa Museum in Stockholm so Popular?

How can I use commands with sudo without changing owner of the files?

Why is it to say 'paucis post diebus'?

Plotting Autoregressive Functions / Linear Difference Equations

How do I show and not tell a backstory?

Has J.J.Jameson ever found out that Peter Parker is Spider-Man?

A verb for when some rights are not violated?

Are valid inequalities worth the effort given modern solver preprocessing options?

What license to choose for my PhD thesis?

“The Fourier transform cannot measure two phases at the same frequency.” Why not?



Kafka cluster raise error when producing with ruby-kafka


Why do Kafka consumers connect to zookeeper, and producers get metadata from brokers?Kafka hangs when Committing MessagesKafka not receiving message from external producerKafka producer issue: UnknownTopicOrPartitionExceptionKafka console producer can connect locally but not remotelyKafka Receives Messages But Fails To Add To Topic - With Setup Local Kafka VM and Minikube Kubernetes ClusterKafka Consumer not receiving messages if one node of the cluster is downSpring kafka and Kafka ClusterDisconnectException breaks the entire kafka clusterKafka Producer/Consumer reconnect after kafka node failure






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








0















I have kafka exception when producing message with ruby-kafka. It happens sometimes.



Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4



Kafka logs:



[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
 at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
 at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
 at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
 at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
 at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
 at scala.collection.Iterator.foreach(Iterator.scala:929)
 at scala.collection.Iterator.foreach$(Iterator.scala:929)
 at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
 at scala.collection.IterableLike.foreach(IterableLike.scala:71)
 at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
 at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
 at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
 at kafka.network.Processor.run(SocketServer.scala:546)
 at java.lang.Thread.run(Thread.java:748)


Rails logs:



D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed





apache-kafka ruby-kafka







share|improve this question


























  • error seems some version conflict

    – Deadpool
    Mar 27 at 2:51

















0















I have kafka exception when producing message with ruby-kafka. It happens sometimes.



Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4



Kafka logs:



[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
 at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
 at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
 at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
 at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
 at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
 at scala.collection.Iterator.foreach(Iterator.scala:929)
 at scala.collection.Iterator.foreach$(Iterator.scala:929)
 at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
 at scala.collection.IterableLike.foreach(IterableLike.scala:71)
 at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
 at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
 at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
 at kafka.network.Processor.run(SocketServer.scala:546)
 at java.lang.Thread.run(Thread.java:748)


Rails logs:



D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed





apache-kafka ruby-kafka







share|improve this question


























  • error seems some version conflict

    – Deadpool
    Mar 27 at 2:51













0












0








0








I have kafka exception when producing message with ruby-kafka. It happens sometimes.



Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4



Kafka logs:



[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
 at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
 at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
 at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
 at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
 at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
 at scala.collection.Iterator.foreach(Iterator.scala:929)
 at scala.collection.Iterator.foreach$(Iterator.scala:929)
 at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
 at scala.collection.IterableLike.foreach(IterableLike.scala:71)
 at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
 at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
 at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
 at kafka.network.Processor.run(SocketServer.scala:546)
 at java.lang.Thread.run(Thread.java:748)


Rails logs:



D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed





apache-kafka ruby-kafka







share|improve this question
















I have kafka exception when producing message with ruby-kafka. It happens sometimes.



Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4



Kafka logs:



[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
 at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
 at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
 at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
 at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
 at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
 at scala.collection.Iterator.foreach(Iterator.scala:929)
 at scala.collection.Iterator.foreach$(Iterator.scala:929)
 at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
 at scala.collection.IterableLike.foreach(IterableLike.scala:71)
 at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
 at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
 at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
 at kafka.network.Processor.run(SocketServer.scala:546)
 at java.lang.Thread.run(Thread.java:748)


Rails logs:



D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed





apache-kafka ruby-kafka




apache-kafka ruby-kafka






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Mar 27 at 2:46







jkhas

















asked Mar 27 at 2:35









jkhasjkhas

11 bronze badge




11 bronze badge















  • error seems some version conflict

    – Deadpool
    Mar 27 at 2:51

















  • error seems some version conflict

    – Deadpool
    Mar 27 at 2:51
















error seems some version conflict

– Deadpool
Mar 27 at 2:51





error seems some version conflict

– Deadpool
Mar 27 at 2:51












0






active

oldest

votes










Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55368942%2fkafka-cluster-raise-error-when-producing-with-ruby-kafka%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes




Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.







Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.



















draft saved

draft discarded
















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid …


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55368942%2fkafka-cluster-raise-error-when-producing-with-ruby-kafka%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







-

Popular posts from this blog

Kamusi Yaliyomo Aina za kamusi | Muundo wa kamusi | Faida za kamusi | Dhima ya picha katika kamusi | Marejeo | Tazama pia | Viungo vya nje | UrambazajiKuhusu kamusiGo-SwahiliWiki-KamusiKamusi ya Kiswahili na Kiingerezakuihariri na kuongeza habari

Image
Pages using ISBN magic linksMbegu za lughaKamusiIsimu nenoKiarabukitabulughaKiswahilialfabetimaanaufafanuzimanenomuhtasarisarufividahizoalfabeti Kamusi Kutoka Wikipedia, kamusi elezo huru Jump to navigation Jump to search Kamusi za Kiswahili Kamusi ya Kiswahili-Kiswahili (kamusi wahidiya) Kamusi ya Kiswahili - Kiingereza (kamusi thania) Kamusi (kutoka neno la Kiarabu قاموس qamus ) ni kitabu ambacho kinaorodhesha maneno ya lugha yaliyokusanywa kutoka kwa watumiaji wa lugha fulani, kwa mfano lugha ya Kiswahili. Maneno hupangwa kwa mtindo wa alfabeti, hutoa maana, asili na ufafanuzi wa utumizi wa maneno na jinsi yanavyotumika au yanavyotamkwa. [1] Yaliyomo 1 Aina za kamusi 2 Muundo wa kamusi 2.1 1. Utangulizi wa kamusi 2.2 2. Matini ya kamusi 2.3 3. Sherehe ya kamusi 3 Faida za kamusi 4 Dhima ya picha katika kamusi 5 Marejeo 6 Tazama pia 7 Viungo vya nje Aina za kamusi | Kuna aina mbalimbali za kamusi ambazo n...
Read more

SQL error code 1064 with creating Laravel foreign keysForeign key constraints: When to use ON UPDATE and ON DELETEDropping column with foreign key Laravel error: General error: 1025 Error on renameLaravel SQL Can't create tableLaravel Migration foreign key errorLaravel php artisan migrate:refresh giving a syntax errorSQLSTATE[42S01]: Base table or view already exists or Base table or view already exists: 1050 Tableerror in migrating laravel file to xampp serverSyntax error or access violation: 1064:syntax to use near 'unsigned not null, modelName varchar(191) not null, title varchar(191) not nLaravel cannot create new table field in mysqlLaravel 5.7:Last migration creates table but is not registered in the migration table

Image
Does a multiclassed wizard start with a spellbook? Minimizing medical costs with HSA Boss has banned cycling to work because he thinks it's unsafe Is there a typical layout to blocking installed for backing in new construction framing? In the Seventh Seal why does Death let the chess game happen? Why has Novell never written its own boot loader? Should I warn my boss I might take sick leave Why is the saxophone not common in classical repertoire? Is it possible to spoof an IP address to an exact number? Motorcyle Chain needs to be cleaned every time you lube it? Bypass with wrong cvv of debit card and getting OTP Do we have a much compact and generalized version of erase–remove idiom? how can i make this execution plan more efficient? Why did moving the mouse cursor cause Windows 95 to run more quickly? What's the big deal about the Nazgûl losing their horses? Has chattel slavery ever been used as a criminal punishment in the USA since the passag...
Read more

은진 송씨 목차 역사 본관 분파 인물 조선 왕실과의 인척 관계 집성촌 항렬자 인구 같이 보기 각주 둘러보기 메뉴은진 송씨세종실록 149권, 지리지 충청도 공주목 은진현

Image
송씨은진 송씨충청남도 소재 성씨논산시 충청남도논산시은진면한국의 성씨고려송명의회덕 황씨류준고흥 류씨송유조선송준길문묘송시열좌의정문묘종묘송준길송규렴송상기송시열송인수송환기송치규송근수충청남도논산시은진면백제757년충청남도은진군논산군논산시은진면송유 은...
Read more