Kafka cluster raise error when producing with ruby-kafkaWhy do Kafka consumers connect to zookeeper, and producers get metadata from brokers?Kafka hangs when Committing MessagesKafka not receiving message from external producerKafka producer issue: UnknownTopicOrPartitionExceptionKafka console producer can connect locally but not remotelyKafka Receives Messages But Fails To Add To Topic - With Setup Local Kafka VM and Minikube Kubernetes ClusterKafka Consumer not receiving messages if one node of the cluster is downSpring kafka and Kafka ClusterDisconnectException breaks the entire kafka clusterKafka Producer/Consumer reconnect after kafka node failure

Can you put ranks into knowledge skills that aren't class skills?

Is space radiation a risk for space film photography, and how is this prevented?

C# TCP server/client class

What is the reason behind water not falling from a bucket at the top of loop?

What is it exactly about flying a Flyboard across the English channel that made Zapata's thighs burn?

What percentage of campground outlets are GFCI or RCD protected?

Why does putting a dot after the URL remove login information?

Is it okay to use different fingers every time while playing a song on keyboard? Is it considered a bad practice?

Can I use my US callsign to transmit while in El Salvador?

Is there a way to improve my grade after graduation?

How do the surviving Asgardians get to Earth?

Broken bottom bracket?

How to call made-up data?

Formal mathematical definition of renormalization group flow

Why is the Vasa Museum in Stockholm so Popular?

How can I use commands with sudo without changing owner of the files?

Why is it to say 'paucis post diebus'?

Plotting Autoregressive Functions / Linear Difference Equations

How do I show and not tell a backstory?

Has J.J.Jameson ever found out that Peter Parker is Spider-Man?

A verb for when some rights are not violated?

Are valid inequalities worth the effort given modern solver preprocessing options?

What license to choose for my PhD thesis?

“The Fourier transform cannot measure two phases at the same frequency.” Why not?



Kafka cluster raise error when producing with ruby-kafka


Why do Kafka consumers connect to zookeeper, and producers get metadata from brokers?Kafka hangs when Committing MessagesKafka not receiving message from external producerKafka producer issue: UnknownTopicOrPartitionExceptionKafka console producer can connect locally but not remotelyKafka Receives Messages But Fails To Add To Topic - With Setup Local Kafka VM and Minikube Kubernetes ClusterKafka Consumer not receiving messages if one node of the cluster is downSpring kafka and Kafka ClusterDisconnectException breaks the entire kafka clusterKafka Producer/Consumer reconnect after kafka node failure






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








0















I have kafka exception when producing message with ruby-kafka. It happens sometimes.



Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4



Kafka logs:



[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
 at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
 at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
 at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
 at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
 at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
 at scala.collection.Iterator.foreach(Iterator.scala:929)
 at scala.collection.Iterator.foreach$(Iterator.scala:929)
 at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
 at scala.collection.IterableLike.foreach(IterableLike.scala:71)
 at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
 at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
 at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
 at kafka.network.Processor.run(SocketServer.scala:546)
 at java.lang.Thread.run(Thread.java:748)


Rails logs:



D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed





apache-kafka ruby-kafka







share|improve this question


























  • error seems some version conflict

    – Deadpool
    Mar 27 at 2:51

















0















I have kafka exception when producing message with ruby-kafka. It happens sometimes.



Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4



Kafka logs:



[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
 at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
 at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
 at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
 at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
 at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
 at scala.collection.Iterator.foreach(Iterator.scala:929)
 at scala.collection.Iterator.foreach$(Iterator.scala:929)
 at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
 at scala.collection.IterableLike.foreach(IterableLike.scala:71)
 at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
 at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
 at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
 at kafka.network.Processor.run(SocketServer.scala:546)
 at java.lang.Thread.run(Thread.java:748)


Rails logs:



D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed





apache-kafka ruby-kafka







share|improve this question


























  • error seems some version conflict

    – Deadpool
    Mar 27 at 2:51













0












0








0








I have kafka exception when producing message with ruby-kafka. It happens sometimes.



Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4



Kafka logs:



[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
 at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
 at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
 at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
 at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
 at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
 at scala.collection.Iterator.foreach(Iterator.scala:929)
 at scala.collection.Iterator.foreach$(Iterator.scala:929)
 at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
 at scala.collection.IterableLike.foreach(IterableLike.scala:71)
 at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
 at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
 at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
 at kafka.network.Processor.run(SocketServer.scala:546)
 at java.lang.Thread.run(Thread.java:748)


Rails logs:



D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed





apache-kafka ruby-kafka







share|improve this question
















I have kafka exception when producing message with ruby-kafka. It happens sometimes.



Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4



Kafka logs:



[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
 at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
 at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
 at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
 at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
 at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
 at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
 at scala.collection.Iterator.foreach(Iterator.scala:929)
 at scala.collection.Iterator.foreach$(Iterator.scala:929)
 at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
 at scala.collection.IterableLike.foreach(IterableLike.scala:71)
 at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
 at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
 at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
 at kafka.network.Processor.run(SocketServer.scala:546)
 at java.lang.Thread.run(Thread.java:748)


Rails logs:



D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed





apache-kafka ruby-kafka




apache-kafka ruby-kafka






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Mar 27 at 2:46







jkhas

















asked Mar 27 at 2:35









jkhasjkhas

11 bronze badge




11 bronze badge















  • error seems some version conflict

    – Deadpool
    Mar 27 at 2:51

















  • error seems some version conflict

    – Deadpool
    Mar 27 at 2:51
















error seems some version conflict

– Deadpool
Mar 27 at 2:51





error seems some version conflict

– Deadpool
Mar 27 at 2:51












0






active

oldest

votes










Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55368942%2fkafka-cluster-raise-error-when-producing-with-ruby-kafka%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes




Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.







Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.



















draft saved

draft discarded
















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid …


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55368942%2fkafka-cluster-raise-error-when-producing-with-ruby-kafka%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







-

Popular posts from this blog

Obelisk of Theodosius Contents History Description Notes Bibliography Further reading External links Navigation menuAge of spirituality : late antique and early Christian art, third to seventh centuryOver 60 picturesObelisks of the World41°00′21.24″N 28°58′31.43″E / 41.0059000°N 28.9753972°E / 41.0059000; 28.97539727724550-7235741376235741376

Image
Obelisks in IstanbulAncient Egyptian obelisksRelocated ancient Egyptian monumentsLatin inscriptionsByzantine Greek inscriptionsVictory monumentsHippodrome of Constantinople4th-century Roman sculptures15th-century BC stelesThutmose III TurkishAncient EgyptianobeliskPharaohThutmose IIIHippodromeConstantinopleIstanbulTurkeyRoman emperorTheodosius I18th dynastyThutmose IIIpylontemple of KarnakConstantius IIriver NileAlexandriaCircus MaximusRomeLateran ObeliskTheodosius IAswanLateran Obeliskvictory over the MitanniCorinthianwater organCtesibiusporphyryhexameterselegiaccoupletsByzantine Greek Obelisk of Theodosius From Wikipedia, the free encyclopedia Jump to navigation Jump to search The obelisk of Theodosius I in Istanbul. The Obelisk of Theodosius (Turkish: Dikilitaş ) is the Ancient Egyptian obelisk of Pharaoh Thutmose III re-erected in the Hippodrome of Constantinople (known today as At Meydanı or Sultanahmet Meydanı , in the modern...
Read more

밀양 대씨 역사 각주 함께 보기 둘러보기 메뉴밀양 대씨

Image
대씨밀양 대씨발해의 왕족발해 한국의 성씨발해대중상고구려대조영고구려발해발해요(遼)나라대광현대인선 밀양 대씨 위키백과, 우리 모두의 백과사전. 둘러보기로 가기 검색하러 가기 밀양 대씨(密陽 大氏) 관향 경상남도 밀양시 시조 대조영(大祚榮) 주요 중시조 대덕세 (大德歲) 인구 (2000...
Read more

1973년 목차 사건 문화 탄생 사망 노벨상 달력 둘러보기 메뉴

Image
1973년 월요일로 시작하는 평년 1973년 위키백과, 우리 모두의 백과사전. 둘러보기로 가기 검색하러 가기 해 1970년 1971년 1972년 - 1973년 - 1974년 1975년 1976년 연대 1950년대 1960년대 - 1970년대 - 1980년대 1990년대 세기 18세기 19세기 - 20세기 - 21세기 22세기 서기 1973년의 다른 기년법 간지 임자년~계축년 단기 4306년 그레고리력 1973년 MCMLXXIII 불기 2517년 이...
Read more