In the nifi flow, is there a way to append filename as part of each file sent to putKinesisStream processorApache Nifi - get the file attributes and construct the json through custom processorwhere to convert .xls file to json file inside Nifi data flow?custom nifi processor - writing of flow fileSpark Streaming with NifiNiFi Flowfile Attributes from KafkaConsumerCreating larger NiFi flow files when using the ConsumeKafka processorHow to assign a name to image which is getting stored from Nifi's PutFile Processor ? Name to be assigned and image appear in different flow fileAccessing lineage of a NiFi flow fileNifi Processor gets triggered twice for single Input flow fileApache NiFi GetMongoProcessor - not continuously producing flow files

Multi tool use
"Estrontium" on poster
Double underlining a result in a system of equations with calculation steps on the right side
Is there a need for better software for writers?
What's the difference between "ricochet" and "bounce"?
How to get MAX value using SOQL when there are more than 50,000 rows
When do you stop "pushing" a book?
How to efficiently lower your karma in fallout 3
Why was Sam Wilson chosen for this, but not Bucky?
Lorentz invariance of Maxwell's equations in matter
How come mathematicians published in Annals of Eugenics?
How do I minimise waste on a flight?
Locked my sa user out
Are there vaccine ingredients which may not be disclosed ("hidden", "trade secret", or similar)?
How can I test a shell script in a "safe environment" to avoid harm to my computer?
How likely are Coriolis-effect-based quirks to develop in starship crew members?
Names of the Six Tastes
Is there an application which does HTTP PUT?
Was Mohammed the most popular first name for boys born in Berlin in 2018?
Identity of a supposed anonymous referee revealed through "Description" of the report
Using wilcox.test() and t.test() in R yielding different p-values
What are these round pads on the bottom of a PCB?
How is Arya still alive?
What is the radius of the circle in this problem?
Two (probably) equal real numbers which are not proved to be equal?
In the nifi flow, is there a way to append filename as part of each file sent to putKinesisStream processor
Apache Nifi - get the file attributes and construct the json through custom processorwhere to convert .xls file to json file inside Nifi data flow?custom nifi processor - writing of flow fileSpark Streaming with NifiNiFi Flowfile Attributes from KafkaConsumerCreating larger NiFi flow files when using the ConsumeKafka processorHow to assign a name to image which is getting stored from Nifi's PutFile Processor ? Name to be assigned and image appear in different flow fileAccessing lineage of a NiFi flow fileNifi Processor gets triggered twice for single Input flow fileApache NiFi GetMongoProcessor - not continuously producing flow files
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.
NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.
I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?
apache-spark spark-streaming apache-nifi amazon-kinesis
add a comment |
I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.
NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.
I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?
apache-spark spark-streaming apache-nifi amazon-kinesis
You could do it with script, but better to provide example of your file content and expected result
– daggett
Mar 23 at 9:41
add a comment |
I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.
NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.
I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?
apache-spark spark-streaming apache-nifi amazon-kinesis
I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.
NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.
I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?
apache-spark spark-streaming apache-nifi amazon-kinesis
apache-spark spark-streaming apache-nifi amazon-kinesis
edited Mar 24 at 19:58


Jacek Laskowski
47.1k18141280
47.1k18141280
asked Mar 23 at 8:48
NikhilNikhil
1
1
You could do it with script, but better to provide example of your file content and expected result
– daggett
Mar 23 at 9:41
add a comment |
You could do it with script, but better to provide example of your file content and expected result
– daggett
Mar 23 at 9:41
You could do it with script, but better to provide example of your file content and expected result
– daggett
Mar 23 at 9:41
You could do it with script, but better to provide example of your file content and expected result
– daggett
Mar 23 at 9:41
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55312095%2fin-the-nifi-flow-is-there-a-way-to-append-filename-as-part-of-each-file-sent-to%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55312095%2fin-the-nifi-flow-is-there-a-way-to-append-filename-as-part-of-each-file-sent-to%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
gDy19cnZR
You could do it with script, but better to provide example of your file content and expected result
– daggett
Mar 23 at 9:41