Kafka cluster raise error when producing with ruby-kafkaWhy do Kafka consumers connect to zookeeper, and producers get metadata from brokers?Kafka hangs when Committing MessagesKafka not receiving message from external producerKafka producer issue: UnknownTopicOrPartitionExceptionKafka console producer can connect locally but not remotelyKafka Receives Messages But Fails To Add To Topic - With Setup Local Kafka VM and Minikube Kubernetes ClusterKafka Consumer not receiving messages if one node of the cluster is downSpring kafka and Kafka ClusterDisconnectException breaks the entire kafka clusterKafka Producer/Consumer reconnect after kafka node failure
Can you put ranks into knowledge skills that aren't class skills?
Is space radiation a risk for space film photography, and how is this prevented?
C# TCP server/client class
What is the reason behind water not falling from a bucket at the top of loop?
What is it exactly about flying a Flyboard across the English channel that made Zapata's thighs burn?
What percentage of campground outlets are GFCI or RCD protected?
Why does putting a dot after the URL remove login information?
Is it okay to use different fingers every time while playing a song on keyboard? Is it considered a bad practice?
Can I use my US callsign to transmit while in El Salvador?
Is there a way to improve my grade after graduation?
How do the surviving Asgardians get to Earth?
Broken bottom bracket?
How to call made-up data?
Formal mathematical definition of renormalization group flow
Why is the Vasa Museum in Stockholm so Popular?
How can I use commands with sudo without changing owner of the files?
Why is it to say 'paucis post diebus'?
Plotting Autoregressive Functions / Linear Difference Equations
How do I show and not tell a backstory?
Has J.J.Jameson ever found out that Peter Parker is Spider-Man?
A verb for when some rights are not violated?
Are valid inequalities worth the effort given modern solver preprocessing options?
What license to choose for my PhD thesis?
“The Fourier transform cannot measure two phases at the same frequency.” Why not?
Kafka cluster raise error when producing with ruby-kafka
Why do Kafka consumers connect to zookeeper, and producers get metadata from brokers?Kafka hangs when Committing MessagesKafka not receiving message from external producerKafka producer issue: UnknownTopicOrPartitionExceptionKafka console producer can connect locally but not remotelyKafka Receives Messages But Fails To Add To Topic - With Setup Local Kafka VM and Minikube Kubernetes ClusterKafka Consumer not receiving messages if one node of the cluster is downSpring kafka and Kafka ClusterDisconnectException breaks the entire kafka clusterKafka Producer/Consumer reconnect after kafka node failure
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
0
I have kafka exception when producing message with ruby-kafka. It happens sometimes.
Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4
Kafka logs:
[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
at scala.collection.Iterator.foreach(Iterator.scala:929)
at scala.collection.Iterator.foreach$(Iterator.scala:929)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
at scala.collection.IterableLike.foreach(IterableLike.scala:71)
at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
at kafka.network.Processor.run(SocketServer.scala:546)
at java.lang.Thread.run(Thread.java:748)
Rails logs:
D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed
apache-kafka ruby-kafka
asked Mar 27 at 2:35
jkhasjkhas
11 bronze badge
add a comment |
0
I have kafka exception when producing message with ruby-kafka. It happens sometimes.
Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4
Kafka logs:
[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
at scala.collection.Iterator.foreach(Iterator.scala:929)
at scala.collection.Iterator.foreach$(Iterator.scala:929)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
at scala.collection.IterableLike.foreach(IterableLike.scala:71)
at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
at kafka.network.Processor.run(SocketServer.scala:546)
at java.lang.Thread.run(Thread.java:748)
Rails logs:
D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed
apache-kafka ruby-kafka
asked Mar 27 at 2:35
jkhasjkhas
11 bronze badge
error seems some version conflict
– Deadpool
Mar 27 at 2:51
add a comment |
0
0
0
I have kafka exception when producing message with ruby-kafka. It happens sometimes.
Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4
Kafka logs:
[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
at scala.collection.Iterator.foreach(Iterator.scala:929)
at scala.collection.Iterator.foreach$(Iterator.scala:929)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
at scala.collection.IterableLike.foreach(IterableLike.scala:71)
at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
at kafka.network.Processor.run(SocketServer.scala:546)
at java.lang.Thread.run(Thread.java:748)
Rails logs:
D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed
apache-kafka ruby-kafka
asked Mar 27 at 2:35
jkhasjkhas
11 bronze badge
I have kafka exception when producing message with ruby-kafka. It happens sometimes.
Kafka 1.1.0, Scala 2.12, ruby-kafka 0.7.4
Kafka logs:
[2019-03-27 02:11:51,879] ERROR Exception while processing request from <ip-here>:9092-<ip-here>:47916-105818 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: PRODUCE, apiVersion: 796, connectionId: <ip-here>:9092-<ip-here>:47916-105818, listenerName: ListenerName(PLAINTEXT), principal: User:ANONYMOUS
Caused by: java.lang.IllegalArgumentException: Invalid version for API key PRODUCE: 796
at org.apache.kafka.common.protocol.ApiKeys.schemaFor(ApiKeys.java:312)
at org.apache.kafka.common.protocol.ApiKeys.requestSchema(ApiKeys.java:282)
at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:290)
at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:63)
at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:89)
at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:646)
at kafka.network.Processor.$anonfun$processCompletedReceives$1$adapted(SocketServer.scala:638)
at scala.collection.Iterator.foreach(Iterator.scala:929)
at scala.collection.Iterator.foreach$(Iterator.scala:929)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1417)
at scala.collection.IterableLike.foreach(IterableLike.scala:71)
at scala.collection.IterableLike.foreach$(IterableLike.scala:70)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at kafka.network.Processor.processCompletedReceives(SocketServer.scala:638)
at kafka.network.Processor.run(SocketServer.scala:546)
at java.lang.Thread.run(Thread.java:748)
Rails logs:
D, [2019-03-27T02:02:26.845499 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/32 is node <ip-here>:9092 (node_id=1) [23/1201]
I, [2019-03-27T02:02:26.845549 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=1)
D, [2019-03-27T02:02:26.845631 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 3 to <ip-here>:9092
D, [2019-03-27T02:02:26.845897 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 3 from <ip-here>:9092
E, [2019-03-27T02:02:27.847095 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 7
D, [2019-03-27T02:02:27.847357 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:27.847511 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=1): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:27.847548 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 1 of 2 after 1s
I, [2019-03-27T02:02:28.847796 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:28.848021 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:28.932217 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:28.932509 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:29.017700 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:29.017869 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:90$
2 (node_id=3)
D, [2019-03-27T02:02:29.017919 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:29.018122 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/25 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:29.018207 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:29.018317 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:29.102729 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:29.103614 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
E, [2019-03-27T02:02:30.104998 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Timed out while waiting for response 1
D, [2019-03-27T02:02:30.105443 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:30.105562 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
E, [2019-03-27T02:02:30.105748 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Could not connect to broker <ip-here>:9092 (node_id=2): Connection error Errno::ETIMEDOUT: Connection timed out
W, [2019-03-27T02:02:30.105795 #5309] WARN -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; attempting retry 2 of 2 after 1s
I, [2019-03-27T02:02:31.106013 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Fetching cluster metadata from kafka://<ip-here>:9092
D, [2019-03-27T02:02:31.106228 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.191020 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending topic_metadata API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.191544 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.277732 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
I, [2019-03-27T02:02:31.277865 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Discovered cluster metadata; nodes: <ip-here>:9092 (node_id=2), <ip-here>:9092 (node_id=1), <ip-here>:909
2 (node_id=3)
D, [2019-03-27T02:02:31.277907 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Closing socket to <ip-here>:9092
D, [2019-03-27T02:02:31.278365 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/48 is node <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278442 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Current leader for upinus-shopify-order/13 is node <ip-here>:9092 (node_id=2)
I, [2019-03-27T02:02:31.278477 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=3)
D, [2019-03-27T02:02:31.278591 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.362539 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.362978 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447673 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.447791 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/48 on <ip-here>:9092 (node_id=3)
I, [2019-03-27T02:02:31.447831 #5309] INFO -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending 1 messages to <ip-here>:9092 (node_id=2)
D, [2019-03-27T02:02:31.447905 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Opening connection to <ip-here>:9092 with client id ruby-kafka...
D, [2019-03-27T02:02:31.532073 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Sending produce API request 1 to <ip-here>:9092
D, [2019-03-27T02:02:31.532353 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Waiting for response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617054 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Received response 1 from <ip-here>:9092
D, [2019-03-27T02:02:31.617153 #5309] DEBUG -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Successfully appended 1 messages to upinus-shopify-order/13 on <ip-here>:9092 (node_id=2)
E, [2019-03-27T02:02:31.617187 #5309] ERROR -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Failed to send all messages; keeping remaining messages in buffer
F, [2019-03-27T02:02:31.617290 #5309] FATAL -- : [2e31f466-71c9-49b4-a7a6-2749f5792778] Delivery message failed
apache-kafka ruby-kafka
apache-kafka ruby-kafka
asked Mar 27 at 2:35
jkhasjkhas
11 bronze badge
asked Mar 27 at 2:35
jkhasjkhas
11 bronze badge
edited Mar 27 at 2:46
jkhas
asked Mar 27 at 2:35
jkhasjkhas
11 bronze badge
asked Mar 27 at 2:35
jkhasjkhas
11 bronze badge
asked Mar 27 at 2:35
jkhasjkhas
11 bronze badge
11 bronze badge
error seems some version conflict
– Deadpool
Mar 27 at 2:51
add a comment |
error seems some version conflict
– Deadpool
Mar 27 at 2:51
error seems some version conflict
– Deadpool
Mar 27 at 2:51
error seems some version conflict
– Deadpool
Mar 27 at 2:51
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55368942%2fkafka-cluster-raise-error-when-producing-with-ruby-kafka%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.
Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.
draft saved
draft discarded
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55368942%2fkafka-cluster-raise-error-when-producing-with-ruby-kafka%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
error seems some version conflict
– Deadpool
Mar 27 at 2:51