Why do files need time to synchronize after writing in writeType THROUGH in Alluxio?Need help on setup alluxio in single nodealluxio not distributing files across the clusterwhy alluxio files keep a state of TO_BE_PERSISTED all the timewriting data to alluxio with CACHE_THROUGH is failingAlluxio - access existing files in underfsspark LOCAL and alluxio clientUnable to access Alluxio File System API in IDEWhy does UfsSyncPathCache.java:68 parameter not work in Alluxio?In Alluxio, if level 0 is set to memory and the size is set to 5G, how can I read and write files over 5G?Qustion about config of level0.dirs.quota and alluxio.user.file.write.tier.default in Alluxio
Mistakenly modified `/bin/sh'
Why is the collector feedback bias popular in electret-mic preamp circuits?
What are the arguments for California’s nonpartisan blanket primaries other than giving Democrats more power?
Relationship between GCD, LCM and the Riemann Zeta function
how to generate correct single and double quotes in tex
Why is dry soil hydrophobic? Bad gardener paradox
How can I legally visit the United States Minor Outlying Islands in the Pacific?
Crab Nebula short story from 1960s or '70s
Commutator subgroup of Heisenberg group.
How are "soeben" and "eben" different from one another?
Is `curl something | sudo bash -` a reasonably safe installation method?
Does optical correction give a more aesthetic look to the SBI logo?
Nested-Loop-Join: How many comparisons and how many pages-accesses?
Is this a plot hole in the Lost Mine of Phandelver adventure?
How would you write do the dialogues of two characters talking in a chat room?
Is a public company able to check out who owns its shares in very detailed format?
What exactly is the Tension force?
Why is "dark" an adverb in this sentence?
Old short story where the future emperor of the galaxy is taken for a tour around Earth
How would someone destroy a black hole that’s at the centre of a planet?
Connect neutrals together in 3-gang box (load side) with 3x 3-way switches?
What is the closed form of the following recursive function?
Krazy language in Krazy Kat, 25 July 1936
Align by center of symbol
Why do files need time to synchronize after writing in writeType THROUGH in Alluxio?
Need help on setup alluxio in single nodealluxio not distributing files across the clusterwhy alluxio files keep a state of TO_BE_PERSISTED all the timewriting data to alluxio with CACHE_THROUGH is failingAlluxio - access existing files in underfsspark LOCAL and alluxio clientUnable to access Alluxio File System API in IDEWhy does UfsSyncPathCache.java:68 parameter not work in Alluxio?In Alluxio, if level 0 is set to memory and the size is set to 5G, how can I read and write files over 5G?Qustion about config of level0.dirs.quota and alluxio.user.file.write.tier.default in Alluxio
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
When I write file in directory mounted by alluxio-fuse using writeType THROUGH. I find that it takes 2-3 minutes to synchronize files. Why do files need time to synchronize?
Following is mount direactory. write time : 15:40. after sync: 15:43
alluxio
asked Mar 26 at 6:34
Shuocheng WangShuocheng Wang
123 bronze badges
add a comment |
When I write file in directory mounted by alluxio-fuse using writeType THROUGH. I find that it takes 2-3 minutes to synchronize files. Why do files need time to synchronize?
Following is mount direactory. write time : 15:40. after sync: 15:43
alluxio
asked Mar 26 at 6:34
Shuocheng WangShuocheng Wang
123 bronze badges
add a comment |
When I write file in directory mounted by alluxio-fuse using writeType THROUGH. I find that it takes 2-3 minutes to synchronize files. Why do files need time to synchronize?
Following is mount direactory. write time : 15:40. after sync: 15:43
alluxio
asked Mar 26 at 6:34
Shuocheng WangShuocheng Wang
123 bronze badges
When I write file in directory mounted by alluxio-fuse using writeType THROUGH. I find that it takes 2-3 minutes to synchronize files. Why do files need time to synchronize?
Following is mount direactory. write time : 15:40. after sync: 15:43
alluxio
alluxio
asked Mar 26 at 6:34
Shuocheng WangShuocheng Wang
123 bronze badges
asked Mar 26 at 6:34
Shuocheng WangShuocheng Wang
123 bronze badges
asked Mar 26 at 6:34
Shuocheng WangShuocheng Wang
123 bronze badges
asked Mar 26 at 6:34
Shuocheng WangShuocheng Wang
123 bronze badges
asked Mar 26 at 6:34
Shuocheng WangShuocheng Wang
123 bronze badges
123 bronze badges
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
When writing to Alluxio with THROUGH writeType, Alluxio will first update its metadata to show files with zero bytes (like the 9.txt in your first image). When the file is successfully written to Alluxio Under FileSystem, Alluxio will update its metadata to show the actual size of this file (9.txt show its actual size as 209715200 bytes).
The 2 to 3 minutes is the time that Alluxio writes data to under filesystem.
Thanks,
answered Mar 26 at 20:03
LuQQiuLuQQiu
741 silver badge3 bronze badges
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55351083%2fwhy-do-files-need-time-to-synchronize-after-writing-in-writetype-through-in-allu%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
When writing to Alluxio with THROUGH writeType, Alluxio will first update its metadata to show files with zero bytes (like the 9.txt in your first image). When the file is successfully written to Alluxio Under FileSystem, Alluxio will update its metadata to show the actual size of this file (9.txt show its actual size as 209715200 bytes).
The 2 to 3 minutes is the time that Alluxio writes data to under filesystem.
Thanks,
answered Mar 26 at 20:03
LuQQiuLuQQiu
741 silver badge3 bronze badges
add a comment |
When writing to Alluxio with THROUGH writeType, Alluxio will first update its metadata to show files with zero bytes (like the 9.txt in your first image). When the file is successfully written to Alluxio Under FileSystem, Alluxio will update its metadata to show the actual size of this file (9.txt show its actual size as 209715200 bytes).
The 2 to 3 minutes is the time that Alluxio writes data to under filesystem.
Thanks,
answered Mar 26 at 20:03
LuQQiuLuQQiu
741 silver badge3 bronze badges
add a comment |
When writing to Alluxio with THROUGH writeType, Alluxio will first update its metadata to show files with zero bytes (like the 9.txt in your first image). When the file is successfully written to Alluxio Under FileSystem, Alluxio will update its metadata to show the actual size of this file (9.txt show its actual size as 209715200 bytes).
The 2 to 3 minutes is the time that Alluxio writes data to under filesystem.
Thanks,
answered Mar 26 at 20:03
LuQQiuLuQQiu
741 silver badge3 bronze badges
When writing to Alluxio with THROUGH writeType, Alluxio will first update its metadata to show files with zero bytes (like the 9.txt in your first image). When the file is successfully written to Alluxio Under FileSystem, Alluxio will update its metadata to show the actual size of this file (9.txt show its actual size as 209715200 bytes).
The 2 to 3 minutes is the time that Alluxio writes data to under filesystem.
Thanks,
answered Mar 26 at 20:03
LuQQiuLuQQiu
741 silver badge3 bronze badges
answered Mar 26 at 20:03
LuQQiuLuQQiu
741 silver badge3 bronze badges
answered Mar 26 at 20:03
LuQQiuLuQQiu
741 silver badge3 bronze badges
answered Mar 26 at 20:03
LuQQiuLuQQiu
741 silver badge3 bronze badges
741 silver badge3 bronze badges
add a comment |
add a comment |
Got a question that you can’t ask on public Stack Overflow? Learn more about sharing private information with Stack Overflow for Teams.
Got a question that you can’t ask on public Stack Overflow? Learn more about sharing private information with Stack Overflow for Teams.
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55351083%2fwhy-do-files-need-time-to-synchronize-after-writing-in-writetype-through-in-allu%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
