In the nifi flow, is there a way to append filename as part of each file sent to putKinesisStream processorApache Nifi - get the file attributes and construct the json through custom processorwhere to convert .xls file to json file inside Nifi data flow?custom nifi processor - writing of flow fileSpark Streaming with NifiNiFi Flowfile Attributes from KafkaConsumerCreating larger NiFi flow files when using the ConsumeKafka processorHow to assign a name to image which is getting stored from Nifi's PutFile Processor ? Name to be assigned and image appear in different flow fileAccessing lineage of a NiFi flow fileNifi Processor gets triggered twice for single Input flow fileApache NiFi GetMongoProcessor - not continuously producing flow files

"Estrontium" on poster

Double underlining a result in a system of equations with calculation steps on the right side

Is there a need for better software for writers?

What's the difference between "ricochet" and "bounce"?

How to get MAX value using SOQL when there are more than 50,000 rows

When do you stop "pushing" a book?

How to efficiently lower your karma in fallout 3

Why was Sam Wilson chosen for this, but not Bucky?

Lorentz invariance of Maxwell's equations in matter

How come mathematicians published in Annals of Eugenics?

How do I minimise waste on a flight?

Locked my sa user out

Are there vaccine ingredients which may not be disclosed ("hidden", "trade secret", or similar)?

How can I test a shell script in a "safe environment" to avoid harm to my computer?

How likely are Coriolis-effect-based quirks to develop in starship crew members?

Names of the Six Tastes

Is there an application which does HTTP PUT?

Was Mohammed the most popular first name for boys born in Berlin in 2018?

Identity of a supposed anonymous referee revealed through "Description" of the report

Using wilcox.test() and t.test() in R yielding different p-values

What are these round pads on the bottom of a PCB?

How is Arya still alive?

What is the radius of the circle in this problem?

Two (probably) equal real numbers which are not proved to be equal?



In the nifi flow, is there a way to append filename as part of each file sent to putKinesisStream processor


Apache Nifi - get the file attributes and construct the json through custom processorwhere to convert .xls file to json file inside Nifi data flow?custom nifi processor - writing of flow fileSpark Streaming with NifiNiFi Flowfile Attributes from KafkaConsumerCreating larger NiFi flow files when using the ConsumeKafka processorHow to assign a name to image which is getting stored from Nifi's PutFile Processor ? Name to be assigned and image appear in different flow fileAccessing lineage of a NiFi flow fileNifi Processor gets triggered twice for single Input flow fileApache NiFi GetMongoProcessor - not continuously producing flow files






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








0















I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.



NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.



I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?










share|improve this question
























  • You could do it with script, but better to provide example of your file content and expected result

    – daggett
    Mar 23 at 9:41

















0















I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.



NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.



I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?










share|improve this question
























  • You could do it with script, but better to provide example of your file content and expected result

    – daggett
    Mar 23 at 9:41













0












0








0








I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.



NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.



I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?










share|improve this question
















I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.



NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.



I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?







apache-spark spark-streaming apache-nifi amazon-kinesis






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Mar 24 at 19:58









Jacek Laskowski

47.1k18141280




47.1k18141280










asked Mar 23 at 8:48









NikhilNikhil

1




1












  • You could do it with script, but better to provide example of your file content and expected result

    – daggett
    Mar 23 at 9:41

















  • You could do it with script, but better to provide example of your file content and expected result

    – daggett
    Mar 23 at 9:41
















You could do it with script, but better to provide example of your file content and expected result

– daggett
Mar 23 at 9:41





You could do it with script, but better to provide example of your file content and expected result

– daggett
Mar 23 at 9:41












0






active

oldest

votes












Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55312095%2fin-the-nifi-flow-is-there-a-way-to-append-filename-as-part-of-each-file-sent-to%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55312095%2fin-the-nifi-flow-is-there-a-way-to-append-filename-as-part-of-each-file-sent-to%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Kamusi Yaliyomo Aina za kamusi | Muundo wa kamusi | Faida za kamusi | Dhima ya picha katika kamusi | Marejeo | Tazama pia | Viungo vya nje | UrambazajiKuhusu kamusiGo-SwahiliWiki-KamusiKamusi ya Kiswahili na Kiingerezakuihariri na kuongeza habari

Swift 4 - func physicsWorld not invoked on collision? The Next CEO of Stack OverflowHow to call Objective-C code from Swift#ifdef replacement in the Swift language@selector() in Swift?#pragma mark in Swift?Swift for loop: for index, element in array?dispatch_after - GCD in Swift?Swift Beta performance: sorting arraysSplit a String into an array in Swift?The use of Swift 3 @objc inference in Swift 4 mode is deprecated?How to optimize UITableViewCell, because my UITableView lags

Access current req object everywhere in Node.js ExpressWhy are global variables considered bad practice? (node.js)Using req & res across functionsHow do I get the path to the current script with Node.js?What is Node.js' Connect, Express and “middleware”?Node.js w/ express error handling in callbackHow to access the GET parameters after “?” in Express?Modify Node.js req object parametersAccess “app” variable inside of ExpressJS/ConnectJS middleware?Node.js Express app - request objectAngular Http Module considered middleware?Session variables in ExpressJSAdd properties to the req object in expressjs with Typescript