In the nifi flow, is there a way to append filename as part of each file sent to putKinesisStream processorApache Nifi - get the file attributes and construct the json through custom processorwhere to convert .xls file to json file inside Nifi data flow?custom nifi processor - writing of flow fileSpark Streaming with NifiNiFi Flowfile Attributes from KafkaConsumerCreating larger NiFi flow files when using the ConsumeKafka processorHow to assign a name to image which is getting stored from Nifi's PutFile Processor ? Name to be assigned and image appear in different flow fileAccessing lineage of a NiFi flow fileNifi Processor gets triggered twice for single Input flow fileApache NiFi GetMongoProcessor - not continuously producing flow files

Multi tool use
Multi tool use

"Estrontium" on poster

Double underlining a result in a system of equations with calculation steps on the right side

Is there a need for better software for writers?

What's the difference between "ricochet" and "bounce"?

How to get MAX value using SOQL when there are more than 50,000 rows

When do you stop "pushing" a book?

How to efficiently lower your karma in fallout 3

Why was Sam Wilson chosen for this, but not Bucky?

Lorentz invariance of Maxwell's equations in matter

How come mathematicians published in Annals of Eugenics?

How do I minimise waste on a flight?

Locked my sa user out

Are there vaccine ingredients which may not be disclosed ("hidden", "trade secret", or similar)?

How can I test a shell script in a "safe environment" to avoid harm to my computer?

How likely are Coriolis-effect-based quirks to develop in starship crew members?

Names of the Six Tastes

Is there an application which does HTTP PUT?

Was Mohammed the most popular first name for boys born in Berlin in 2018?

Identity of a supposed anonymous referee revealed through "Description" of the report

Using wilcox.test() and t.test() in R yielding different p-values

What are these round pads on the bottom of a PCB?

How is Arya still alive?

What is the radius of the circle in this problem?

Two (probably) equal real numbers which are not proved to be equal?



In the nifi flow, is there a way to append filename as part of each file sent to putKinesisStream processor


Apache Nifi - get the file attributes and construct the json through custom processorwhere to convert .xls file to json file inside Nifi data flow?custom nifi processor - writing of flow fileSpark Streaming with NifiNiFi Flowfile Attributes from KafkaConsumerCreating larger NiFi flow files when using the ConsumeKafka processorHow to assign a name to image which is getting stored from Nifi's PutFile Processor ? Name to be assigned and image appear in different flow fileAccessing lineage of a NiFi flow fileNifi Processor gets triggered twice for single Input flow fileApache NiFi GetMongoProcessor - not continuously producing flow files






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








0















I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.



NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.



I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?










share|improve this question
























  • You could do it with script, but better to provide example of your file content and expected result

    – daggett
    Mar 23 at 9:41

















0















I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.



NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.



I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?










share|improve this question
























  • You could do it with script, but better to provide example of your file content and expected result

    – daggett
    Mar 23 at 9:41













0












0








0








I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.



NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.



I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?










share|improve this question
















I have a NIFI flow to read files from server and put to Kinesis Stream. I want to read the filename and append it as part of the files/records being sent to putKinesis processor.



NIFI Flow: ListSFTP -- FetchSFTP-- UpdateAttribute -- PutKineses Expected: Fetch filenames read from sftp server and append it to the records that are sent to PutKinesis so that while retrieving the messages user has an idea of tracking the message to which file it belongs to.



I'd like to append the filename to the data (body) which is being sent to Kinesis stream. How to achieve it?







apache-spark spark-streaming apache-nifi amazon-kinesis






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Mar 24 at 19:58









Jacek Laskowski

47.1k18141280




47.1k18141280










asked Mar 23 at 8:48









NikhilNikhil

1




1












  • You could do it with script, but better to provide example of your file content and expected result

    – daggett
    Mar 23 at 9:41

















  • You could do it with script, but better to provide example of your file content and expected result

    – daggett
    Mar 23 at 9:41
















You could do it with script, but better to provide example of your file content and expected result

– daggett
Mar 23 at 9:41





You could do it with script, but better to provide example of your file content and expected result

– daggett
Mar 23 at 9:41












0






active

oldest

votes












Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55312095%2fin-the-nifi-flow-is-there-a-way-to-append-filename-as-part-of-each-file-sent-to%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55312095%2fin-the-nifi-flow-is-there-a-way-to-append-filename-as-part-of-each-file-sent-to%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







gDy19cnZR
a6 H2duK,Qr1PlwUAQqxtEILVk3YUVSypz0hIweaswgIsWAu GYjT5Zlyk3b iXx6u xzb o6 1DNtUjrC,2Vg 7bea7c

Popular posts from this blog

Kamusi Yaliyomo Aina za kamusi | Muundo wa kamusi | Faida za kamusi | Dhima ya picha katika kamusi | Marejeo | Tazama pia | Viungo vya nje | UrambazajiKuhusu kamusiGo-SwahiliWiki-KamusiKamusi ya Kiswahili na Kiingerezakuihariri na kuongeza habari

SQL error code 1064 with creating Laravel foreign keysForeign key constraints: When to use ON UPDATE and ON DELETEDropping column with foreign key Laravel error: General error: 1025 Error on renameLaravel SQL Can't create tableLaravel Migration foreign key errorLaravel php artisan migrate:refresh giving a syntax errorSQLSTATE[42S01]: Base table or view already exists or Base table or view already exists: 1050 Tableerror in migrating laravel file to xampp serverSyntax error or access violation: 1064:syntax to use near 'unsigned not null, modelName varchar(191) not null, title varchar(191) not nLaravel cannot create new table field in mysqlLaravel 5.7:Last migration creates table but is not registered in the migration table

위키백과:대문 둘러보기 메뉴기부 안내모바일판 대문크리에이티브 커먼즈 저작자표시-동일조건변경허락 3.0CebuanoDeutschEnglishEspañolFrançaisItaliano日本語NederlandsPolskiPortuguêsРусскийSvenskaTiếng ViệtWinaray中文العربيةCatalàفارسیSrpskiУкраїнськаБългарскиНохчийнČeštinaDanskEsperantoEuskaraSuomiעבריתMagyarՀայերենBahasa IndonesiaҚазақшаBaso MinangkabauBahasa MelayuBân-lâm-gúNorskRomânăSrpskohrvatskiSlovenčinaTürkçe