IoT Hub Routing Messages to Only One Partition of Event HubWhat is Partition Id,Offset,Host Name in Azure Event Hub Receiver?Azure IoT Hub, EventHub and FunctionsAzure Functions Event Hub trigger bindingsAzure Functions with IoT HubIs there any way to read from specific EventHub Partition using EventProcessorHostProcess Azure IoT hub events from a single device onlyScaling Azure IoT hub, partitioning and custom routes/endpointsEvent Grid Subscription for Event Hub to ingest logs in particular partitionSubscribe to Azure IoT Hub Device EventsHow to connect IoT hub to Kafka enabled event hub?
Isomorphism of fields via the forgetful functor
How long can a 35mm film be used/stored before it starts to lose its quality after expiry?
Visa for volunteering in England
Survey Confirmation - Emphasize the question or the answer?
Hang 20lb projector screen on hardieplank
Melee attacking upwards (enemy on 10ft ceiling)
Historically, were women trained for obligatory wars? Or did they serve some other military function?
CRT Oscilloscope - part of the plot is missing
Copying spell into spellbook time required, consecutive or disparate?
Visualizing a complicated Region
How to get SEEK accessing converted ID via view
LT Spice Voltage Output
How to reply this mail from potential PhD professor?
What are the spoon bit of a spoon and fork bit of a fork called?
Was the ancestor of SCSI, the SASI protocol, nothing more than a draft?
Surprising behavior of Part[ ]
Copy line and insert it in a new position with sed or awk
Can commander tax be proliferated?
How could a planet have most of its water in the atmosphere?
Who died in the Game of Thrones episode, "The Long Night"?
If Melisandre foresaw another character closing blue eyes, why did she follow Stannis?
Loading but not using TikZ changes a file
How to back up a running Linode server?
How did Arya manage to disguise herself?
IoT Hub Routing Messages to Only One Partition of Event Hub
What is Partition Id,Offset,Host Name in Azure Event Hub Receiver?Azure IoT Hub, EventHub and FunctionsAzure Functions Event Hub trigger bindingsAzure Functions with IoT HubIs there any way to read from specific EventHub Partition using EventProcessorHostProcess Azure IoT hub events from a single device onlyScaling Azure IoT hub, partitioning and custom routes/endpointsEvent Grid Subscription for Event Hub to ingest logs in particular partitionSubscribe to Azure IoT Hub Device EventsHow to connect IoT hub to Kafka enabled event hub?
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I have a data pipeline set up in Azure where I send messages to an IoTHub which then routes those messages to an EventHub. When I read from the EventHub using the standard EventProcessorHost method, I find that only one of the partitions is being read from. I assume that only one partition is actually having messages routed to it. I have not specified a partition key anywhere and expect that the messages would be routed to all of the partitions of the event hub using round robin (as per the documentation at https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-programming-guide).
How can I configure my setup to route messages to all partitions of the event hub?
azure azure-iot-hub azure-eventhub asked Mar 22 at 19:59
Aidan BaileyAidan Bailey
51
add a comment |
I have a data pipeline set up in Azure where I send messages to an IoTHub which then routes those messages to an EventHub. When I read from the EventHub using the standard EventProcessorHost method, I find that only one of the partitions is being read from. I assume that only one partition is actually having messages routed to it. I have not specified a partition key anywhere and expect that the messages would be routed to all of the partitions of the event hub using round robin (as per the documentation at https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-programming-guide).
How can I configure my setup to route messages to all partitions of the event hub?
azure azure-iot-hub azure-eventhub asked Mar 22 at 19:59
Aidan BaileyAidan Bailey
51
Is it possible you are only receiving data from one device? IoT Hub does automatic partitioning based on the deviceId, so the partition affinity might be the cause
– Alex AIT
Mar 22 at 22:29
Yes, that's the issue. I was sending a large number of messages to IoT Hub as a single device. Thanks!
– Aidan Bailey
Mar 22 at 23:49
Glad that I could help. I will post the comment as an answer as well so it is more clean. If you accept it then others can see the problem was solved.
– Alex AIT
Mar 23 at 6:57
add a comment |
I have a data pipeline set up in Azure where I send messages to an IoTHub which then routes those messages to an EventHub. When I read from the EventHub using the standard EventProcessorHost method, I find that only one of the partitions is being read from. I assume that only one partition is actually having messages routed to it. I have not specified a partition key anywhere and expect that the messages would be routed to all of the partitions of the event hub using round robin (as per the documentation at https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-programming-guide).
How can I configure my setup to route messages to all partitions of the event hub?
azure azure-iot-hub azure-eventhub asked Mar 22 at 19:59
Aidan BaileyAidan Bailey
51
I have a data pipeline set up in Azure where I send messages to an IoTHub which then routes those messages to an EventHub. When I read from the EventHub using the standard EventProcessorHost method, I find that only one of the partitions is being read from. I assume that only one partition is actually having messages routed to it. I have not specified a partition key anywhere and expect that the messages would be routed to all of the partitions of the event hub using round robin (as per the documentation at https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-programming-guide).
How can I configure my setup to route messages to all partitions of the event hub?
azure azure-iot-hub azure-eventhub azure azure-iot-hub azure-eventhub asked Mar 22 at 19:59
Aidan BaileyAidan Bailey
51
asked Mar 22 at 19:59
Aidan BaileyAidan Bailey
51
asked Mar 22 at 19:59
Aidan BaileyAidan Bailey
51
asked Mar 22 at 19:59
Aidan BaileyAidan Bailey
51
asked Mar 22 at 19:59
Aidan BaileyAidan Bailey
51
51
Is it possible you are only receiving data from one device? IoT Hub does automatic partitioning based on the deviceId, so the partition affinity might be the cause
– Alex AIT
Mar 22 at 22:29
Yes, that's the issue. I was sending a large number of messages to IoT Hub as a single device. Thanks!
– Aidan Bailey
Mar 22 at 23:49
Glad that I could help. I will post the comment as an answer as well so it is more clean. If you accept it then others can see the problem was solved.
– Alex AIT
Mar 23 at 6:57
add a comment |
Is it possible you are only receiving data from one device? IoT Hub does automatic partitioning based on the deviceId, so the partition affinity might be the cause
– Alex AIT
Mar 22 at 22:29
Yes, that's the issue. I was sending a large number of messages to IoT Hub as a single device. Thanks!
– Aidan Bailey
Mar 22 at 23:49
Glad that I could help. I will post the comment as an answer as well so it is more clean. If you accept it then others can see the problem was solved.
– Alex AIT
Mar 23 at 6:57
Is it possible you are only receiving data from one device? IoT Hub does automatic partitioning based on the deviceId, so the partition affinity might be the cause
– Alex AIT
Mar 22 at 22:29
Is it possible you are only receiving data from one device? IoT Hub does automatic partitioning based on the deviceId, so the partition affinity might be the cause
– Alex AIT
Mar 22 at 22:29
Yes, that's the issue. I was sending a large number of messages to IoT Hub as a single device. Thanks!
– Aidan Bailey
Mar 22 at 23:49
Yes, that's the issue. I was sending a large number of messages to IoT Hub as a single device. Thanks!
– Aidan Bailey
Mar 22 at 23:49
Glad that I could help. I will post the comment as an answer as well so it is more clean. If you accept it then others can see the problem was solved.
– Alex AIT
Mar 23 at 6:57
Glad that I could help. I will post the comment as an answer as well so it is more clean. If you accept it then others can see the problem was solved.
– Alex AIT
Mar 23 at 6:57
add a comment |
1 Answer
1
active
oldest
votes
Like I said in the comment:
Is it possible you are only receiving data from one device? IoT Hub does automatic partitioning based on the deviceId, so the partition affinity might be the cause.
answered Mar 23 at 6:58
Alex AITAlex AIT
2,32621225
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55307019%2fiot-hub-routing-messages-to-only-one-partition-of-event-hub%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Like I said in the comment:
Is it possible you are only receiving data from one device? IoT Hub does automatic partitioning based on the deviceId, so the partition affinity might be the cause.
answered Mar 23 at 6:58
Alex AITAlex AIT
2,32621225
add a comment |
Like I said in the comment:
Is it possible you are only receiving data from one device? IoT Hub does automatic partitioning based on the deviceId, so the partition affinity might be the cause.
answered Mar 23 at 6:58
Alex AITAlex AIT
2,32621225
add a comment |
Like I said in the comment:
Is it possible you are only receiving data from one device? IoT Hub does automatic partitioning based on the deviceId, so the partition affinity might be the cause.
answered Mar 23 at 6:58
Alex AITAlex AIT
2,32621225
Like I said in the comment:
Is it possible you are only receiving data from one device? IoT Hub does automatic partitioning based on the deviceId, so the partition affinity might be the cause.
answered Mar 23 at 6:58
Alex AITAlex AIT
2,32621225
answered Mar 23 at 6:58
Alex AITAlex AIT
2,32621225
answered Mar 23 at 6:58
Alex AITAlex AIT
2,32621225
answered Mar 23 at 6:58
Alex AITAlex AIT
2,32621225
2,32621225
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55307019%2fiot-hub-routing-messages-to-only-one-partition-of-event-hub%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Is it possible you are only receiving data from one device? IoT Hub does automatic partitioning based on the deviceId, so the partition affinity might be the cause
– Alex AIT
Mar 22 at 22:29
Yes, that's the issue. I was sending a large number of messages to IoT Hub as a single device. Thanks!
– Aidan Bailey
Mar 22 at 23:49
Glad that I could help. I will post the comment as an answer as well so it is more clean. If you accept it then others can see the problem was solved.
– Alex AIT
Mar 23 at 6:57