How to persist nifi flowfiles by using docker-compose?Docker Compose vs. Dockerfile - which is better?Using Docker-Compose, how to execute multiple commandsHow to restart a single container with docker-composeDocker Compose wait for container X before starting YWhat is the difference between docker and docker-composeDocker-Compose persistent data MySQLWhat is the difference between docker-compose ports vs exposeApache NIFI Install failed as Ambari service - Configuration parameter 'kafka_broker_hosts' was not found in configurations dictionaryApache NiFi stream into InfluxDBIPFIX Streams processing using Apache NiFi
Can an Aarakocra use a shield while flying?
Genetic limitations to learn certain instruments
At what point in time did Dumbledore ask Snape for this favor?
Soft question: Examples where lack of mathematical rigour cause security breaches?
1980s live-action movie where individually-coloured nations on clouds fight
Confusion about off peak timings of London trains
Why would future John risk sending back a T-800 to save his younger self?
Do simulator games use a realistic trajectory to get into orbit?
Compiling c files on ubuntu and using the executable on Windows
An average heaven where everyone has sexless golden bodies and is bored
Why did the Tesseract "burn" a hole through Red Skull's plane but not Nick Fury's desk?
Winning Strategy for the Magician and his Apprentice
What should the arbiter and what should have I done in this case?
Should I avoid hard-packed crusher dust trails with my hybrid?
C++ Arduino IDE receiving garbled `char` from function
Is it a problem if <h4>, <h5> and <h6> are smaller than regular text?
Thread Pool C++ Implementation
English word for "product of tinkering"
How does an ordinary object become radioactive?
What makes an item an artifact?
What is the origin of the German "n-Deklination"?
Does an ice chest packed full of frozen food need ice?
Is counterpoint still used today?
Source that a married woman seduced by a “messianic figure” is still permitted to her husband
How to persist nifi flowfiles by using docker-compose?
Docker Compose vs. Dockerfile - which is better?Using Docker-Compose, how to execute multiple commandsHow to restart a single container with docker-composeDocker Compose wait for container X before starting YWhat is the difference between docker and docker-composeDocker-Compose persistent data MySQLWhat is the difference between docker-compose ports vs exposeApache NIFI Install failed as Ambari service - Configuration parameter 'kafka_broker_hosts' was not found in configurations dictionaryApache NiFi stream into InfluxDBIPFIX Streams processing using Apache NiFi
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
right now I'm using nifi and its processors for some streaming stuff (mqtt listener, json evaluating, text replacement, write into db ...).
I'm trying to persist the flowfiles and therefore I did some volume mapping (see below).
But it doesn't work; after restarting the container it seems the flowfiles arent't saved ...
Could anybody give me a hint how to solve that problem?
nifi:
image: apache/nifi
restart: on-failure
ports:
- "8000:8000"
networks:
- traefik
environment:
- NIFI_WEB_HTTP_PORT=8000
volumes:
- nifi_conf:/opt/nifi/conf
- nifi_state:/data/nifi/state
- nifi_db:/opt/nifi/database_repository
- nifi_flowfile:/opt/nifi/flowfile_repository
- nifi_content:/opt/nifi/content_repository
- nifi_provenance:/opt/nifi/provenance_repository
volumes:
nifi_provenance:
nifi_flowfile:
nifi_content:
nifi_db:
nifi_state:
nifi_conf:
Thanks.
docker-compose apache-nifi
asked Mar 24 at 16:32
T_FT_F
121
add a comment |
right now I'm using nifi and its processors for some streaming stuff (mqtt listener, json evaluating, text replacement, write into db ...).
I'm trying to persist the flowfiles and therefore I did some volume mapping (see below).
But it doesn't work; after restarting the container it seems the flowfiles arent't saved ...
Could anybody give me a hint how to solve that problem?
nifi:
image: apache/nifi
restart: on-failure
ports:
- "8000:8000"
networks:
- traefik
environment:
- NIFI_WEB_HTTP_PORT=8000
volumes:
- nifi_conf:/opt/nifi/conf
- nifi_state:/data/nifi/state
- nifi_db:/opt/nifi/database_repository
- nifi_flowfile:/opt/nifi/flowfile_repository
- nifi_content:/opt/nifi/content_repository
- nifi_provenance:/opt/nifi/provenance_repository
volumes:
nifi_provenance:
nifi_flowfile:
nifi_content:
nifi_db:
nifi_state:
nifi_conf:
Thanks.
docker-compose apache-nifi
asked Mar 24 at 16:32
T_FT_F
121
add a comment |
right now I'm using nifi and its processors for some streaming stuff (mqtt listener, json evaluating, text replacement, write into db ...).
I'm trying to persist the flowfiles and therefore I did some volume mapping (see below).
But it doesn't work; after restarting the container it seems the flowfiles arent't saved ...
Could anybody give me a hint how to solve that problem?
nifi:
image: apache/nifi
restart: on-failure
ports:
- "8000:8000"
networks:
- traefik
environment:
- NIFI_WEB_HTTP_PORT=8000
volumes:
- nifi_conf:/opt/nifi/conf
- nifi_state:/data/nifi/state
- nifi_db:/opt/nifi/database_repository
- nifi_flowfile:/opt/nifi/flowfile_repository
- nifi_content:/opt/nifi/content_repository
- nifi_provenance:/opt/nifi/provenance_repository
volumes:
nifi_provenance:
nifi_flowfile:
nifi_content:
nifi_db:
nifi_state:
nifi_conf:
Thanks.
docker-compose apache-nifi
asked Mar 24 at 16:32
T_FT_F
121
right now I'm using nifi and its processors for some streaming stuff (mqtt listener, json evaluating, text replacement, write into db ...).
I'm trying to persist the flowfiles and therefore I did some volume mapping (see below).
But it doesn't work; after restarting the container it seems the flowfiles arent't saved ...
Could anybody give me a hint how to solve that problem?
nifi:
image: apache/nifi
restart: on-failure
ports:
- "8000:8000"
networks:
- traefik
environment:
- NIFI_WEB_HTTP_PORT=8000
volumes:
- nifi_conf:/opt/nifi/conf
- nifi_state:/data/nifi/state
- nifi_db:/opt/nifi/database_repository
- nifi_flowfile:/opt/nifi/flowfile_repository
- nifi_content:/opt/nifi/content_repository
- nifi_provenance:/opt/nifi/provenance_repository
volumes:
nifi_provenance:
nifi_flowfile:
nifi_content:
nifi_db:
nifi_state:
nifi_conf:
Thanks.
docker-compose apache-nifi
docker-compose apache-nifi
asked Mar 24 at 16:32
T_FT_F
121
asked Mar 24 at 16:32
T_FT_F
121
asked Mar 24 at 16:32
T_FT_F
121
asked Mar 24 at 16:32
T_FT_F
121
asked Mar 24 at 16:32
T_FT_F
121
121
add a comment |
add a comment |
2 Answers
2
active
oldest
votes
you could map docker container folders directly to the host machine like this:
services:
nifi:
...
volumes:
- ./conf:/opt/conf
- ./nifi_state:/data/nifi/state
...
no additional volume definition required
note that under windows with virtualbox this feature works only in the current user directory.
answered Mar 25 at 10:21
daggettdaggett
10.5k21632
add a comment |
Alternatively you could only use docker-compose stop instead of docker-compose down which will not remove your container and thus keeping the volumes mounted.
This means you do not have to do any mapping of volumes and can just use this basic docker-compose file:
version: '2'
services:
futa-nifi-lsc:
environment:
- NIFI_WEB_HTTP_PORT=9000
image: apache/nifi:1.8.0
volumes:
- ./jdbc_driver:/opt/jdbc_driver
- ./checkin_files:/opt/checkin_files
- ./truststore:/opt/truststore
ports:
- "9000:9000"
For more information read this article here.
answered Apr 3 at 12:52
wedererwederer
124111
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55325999%2fhow-to-persist-nifi-flowfiles-by-using-docker-compose%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
you could map docker container folders directly to the host machine like this:
services:
nifi:
...
volumes:
- ./conf:/opt/conf
- ./nifi_state:/data/nifi/state
...
no additional volume definition required
note that under windows with virtualbox this feature works only in the current user directory.
answered Mar 25 at 10:21
daggettdaggett
10.5k21632
add a comment |
you could map docker container folders directly to the host machine like this:
services:
nifi:
...
volumes:
- ./conf:/opt/conf
- ./nifi_state:/data/nifi/state
...
no additional volume definition required
note that under windows with virtualbox this feature works only in the current user directory.
answered Mar 25 at 10:21
daggettdaggett
10.5k21632
add a comment |
you could map docker container folders directly to the host machine like this:
services:
nifi:
...
volumes:
- ./conf:/opt/conf
- ./nifi_state:/data/nifi/state
...
no additional volume definition required
note that under windows with virtualbox this feature works only in the current user directory.
answered Mar 25 at 10:21
daggettdaggett
10.5k21632
you could map docker container folders directly to the host machine like this:
services:
nifi:
...
volumes:
- ./conf:/opt/conf
- ./nifi_state:/data/nifi/state
...
no additional volume definition required
note that under windows with virtualbox this feature works only in the current user directory.
answered Mar 25 at 10:21
daggettdaggett
10.5k21632
answered Mar 25 at 10:21
daggettdaggett
10.5k21632
answered Mar 25 at 10:21
daggettdaggett
10.5k21632
answered Mar 25 at 10:21
daggettdaggett
10.5k21632
10.5k21632
add a comment |
add a comment |
Alternatively you could only use docker-compose stop instead of docker-compose down which will not remove your container and thus keeping the volumes mounted.
This means you do not have to do any mapping of volumes and can just use this basic docker-compose file:
version: '2'
services:
futa-nifi-lsc:
environment:
- NIFI_WEB_HTTP_PORT=9000
image: apache/nifi:1.8.0
volumes:
- ./jdbc_driver:/opt/jdbc_driver
- ./checkin_files:/opt/checkin_files
- ./truststore:/opt/truststore
ports:
- "9000:9000"
For more information read this article here.
answered Apr 3 at 12:52
wedererwederer
124111
add a comment |
Alternatively you could only use docker-compose stop instead of docker-compose down which will not remove your container and thus keeping the volumes mounted.
This means you do not have to do any mapping of volumes and can just use this basic docker-compose file:
version: '2'
services:
futa-nifi-lsc:
environment:
- NIFI_WEB_HTTP_PORT=9000
image: apache/nifi:1.8.0
volumes:
- ./jdbc_driver:/opt/jdbc_driver
- ./checkin_files:/opt/checkin_files
- ./truststore:/opt/truststore
ports:
- "9000:9000"
For more information read this article here.
answered Apr 3 at 12:52
wedererwederer
124111
add a comment |
Alternatively you could only use docker-compose stop instead of docker-compose down which will not remove your container and thus keeping the volumes mounted.
This means you do not have to do any mapping of volumes and can just use this basic docker-compose file:
version: '2'
services:
futa-nifi-lsc:
environment:
- NIFI_WEB_HTTP_PORT=9000
image: apache/nifi:1.8.0
volumes:
- ./jdbc_driver:/opt/jdbc_driver
- ./checkin_files:/opt/checkin_files
- ./truststore:/opt/truststore
ports:
- "9000:9000"
For more information read this article here.
answered Apr 3 at 12:52
wedererwederer
124111
Alternatively you could only use docker-compose stop instead of docker-compose down which will not remove your container and thus keeping the volumes mounted.
This means you do not have to do any mapping of volumes and can just use this basic docker-compose file:
version: '2'
services:
futa-nifi-lsc:
environment:
- NIFI_WEB_HTTP_PORT=9000
image: apache/nifi:1.8.0
volumes:
- ./jdbc_driver:/opt/jdbc_driver
- ./checkin_files:/opt/checkin_files
- ./truststore:/opt/truststore
ports:
- "9000:9000"
For more information read this article here.
answered Apr 3 at 12:52
wedererwederer
124111
answered Apr 3 at 12:52
wedererwederer
124111
answered Apr 3 at 12:52
wedererwederer
124111
answered Apr 3 at 12:52
wedererwederer
124111
124111
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55325999%2fhow-to-persist-nifi-flowfiles-by-using-docker-compose%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
