Duplicate on both S3 and EC2 after mountingmounting an s3 bucket in ec2 and using transparently as a mnt pointVery slow connection between EC2 and S3. Is it normal?s3fs disable cacheHow can I mount an S3 bucket to an EC2 instance and write to it with PHP?mounted s3 bucket files not accessible through apacheCan inotifywait be used with a mounted S3 bucket?How to change the permission for a s3 bucket mounted folderAWS S3 bucket mount script not work on rebootAWS S3FS How toCannot make a directory through php inside mounted s3 bucket
Leveling up and Getting Items!
Is it possible to install Firefox on Ubuntu with no desktop enviroment?
How many possible starting positions are uniquely solvable for a nonogram puzzle?
Why is Skinner so awkward in Hot Fuzz?
Can I give my friend the sour dough "throw away" as a starter to their sourdough starter?
How can religions without a hell discourage evil-doing?
The last tree in the Universe
Do legislators hold the right of legislative initiative?
Reflecting Telescope Blind Spot?
Basic power tool set for Home repair and simple projects
Was the Lonely Mountain, where Smaug lived, a volcano?
Converting 3x7 to a 1x7. Is it possible with only existing parts?
Cant bend fingertip when finger is straight
What does the output current rating from an H-Bridge's datasheet really mean?
Someone who is granted access to information but not expected to read it
How could I create a situation in which a PC has to make a saving throw or be forced to pet a dog?
How do you translate “talk shit”?
Is it unethical to quit my job during company crisis?
How can this shape perfectly cover a cube?
What is the difference between state-based effects and effects on the stack?
I sent an angry e-mail to my interviewers about a conflict at my home institution. Could this affect my application?
Leveraging cash for buying car
How can Caller ID be faked?
For Saintsbury, which English novelists constituted the "great quartet of the mid-eighteenth century"?
Duplicate on both S3 and EC2 after mounting
mounting an s3 bucket in ec2 and using transparently as a mnt pointVery slow connection between EC2 and S3. Is it normal?s3fs disable cacheHow can I mount an S3 bucket to an EC2 instance and write to it with PHP?mounted s3 bucket files not accessible through apacheCan inotifywait be used with a mounted S3 bucket?How to change the permission for a s3 bucket mounted folderAWS S3 bucket mount script not work on rebootAWS S3FS How toCannot make a directory through php inside mounted s3 bucket
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I created S3 bucket and mounted with ec2. When I upload a file to S3 bucket, that file is copied to ec2 mounted folder automatically. I wanted the file to be uploaded to S3 bucket only. As it copies to EC2 folder, it becomes redundant and doesn't fulfill our requirements. I installed S3fs and executed the following commands:
sudo s3fs my-s3-bucket /var/www/html/vqmod/xml/ -o passwd_file=/home/ubuntu/.passwd-s3fs,nonempty,retries=5,gid=33,uid=33,allow_other,url=https://s3.amazonaws.com,umask=0000
Am I doing any permission mistake? Thanks.
Comments:
John Rotenstein: "Why do you wish to mount the bucket on the EC2 instance? Amazon S3 is an object storage system and is not designed to be "mounted". While there are utilities that can do this (eg s3fs), it is not a recommended way to use Amazon S3."
I answered, "My client wants his eCommerce site's cache files to be generated in S3 storage. For this reason, cache folder of eCommerce site should be mounted the bucket."
John Rotenstein: "It will result in exactly the behaviour you describe."
Is there any alternative way to accomplish this requirement?
amazon-s3 amazon-ec2 s3fs
asked Mar 25 at 2:45
AgiloxAgilox
956923
|
show 1 more comment
I created S3 bucket and mounted with ec2. When I upload a file to S3 bucket, that file is copied to ec2 mounted folder automatically. I wanted the file to be uploaded to S3 bucket only. As it copies to EC2 folder, it becomes redundant and doesn't fulfill our requirements. I installed S3fs and executed the following commands:
sudo s3fs my-s3-bucket /var/www/html/vqmod/xml/ -o passwd_file=/home/ubuntu/.passwd-s3fs,nonempty,retries=5,gid=33,uid=33,allow_other,url=https://s3.amazonaws.com,umask=0000
Am I doing any permission mistake? Thanks.
Comments:
John Rotenstein: "Why do you wish to mount the bucket on the EC2 instance? Amazon S3 is an object storage system and is not designed to be "mounted". While there are utilities that can do this (eg s3fs), it is not a recommended way to use Amazon S3."
I answered, "My client wants his eCommerce site's cache files to be generated in S3 storage. For this reason, cache folder of eCommerce site should be mounted the bucket."
John Rotenstein: "It will result in exactly the behaviour you describe."
Is there any alternative way to accomplish this requirement?
amazon-s3 amazon-ec2 s3fs
asked Mar 25 at 2:45
AgiloxAgilox
956923
1
Why do you wish to mount the bucket on the EC2 instance? Amazon S3 is an object storage system and is not designed to be "mounted". While there are utilities that can do this (egs3fs), it is not a recommended way to use Amazon S3.
– John Rotenstein
Mar 25 at 3:11
My client wants his eCommerce site's cache files to be generated in S3 storage. For this reason, cache folder of eCommerce site should be mounted the bucket.
– Agilox
Mar 25 at 5:32
2
Why do they want that? It will result in exactly the behaviour you describe.
– John Rotenstein
Mar 25 at 5:40
Is it possible without mounting?
– Agilox
Mar 25 at 8:23
1
Are you sure the files are duplicated? Mountfing s3fs the files are visible as local, but actually residing in s3. That is what did you want to achieve, isn't it not?
– gusto2
Mar 25 at 8:25
|
show 1 more comment
I created S3 bucket and mounted with ec2. When I upload a file to S3 bucket, that file is copied to ec2 mounted folder automatically. I wanted the file to be uploaded to S3 bucket only. As it copies to EC2 folder, it becomes redundant and doesn't fulfill our requirements. I installed S3fs and executed the following commands:
sudo s3fs my-s3-bucket /var/www/html/vqmod/xml/ -o passwd_file=/home/ubuntu/.passwd-s3fs,nonempty,retries=5,gid=33,uid=33,allow_other,url=https://s3.amazonaws.com,umask=0000
Am I doing any permission mistake? Thanks.
Comments:
John Rotenstein: "Why do you wish to mount the bucket on the EC2 instance? Amazon S3 is an object storage system and is not designed to be "mounted". While there are utilities that can do this (eg s3fs), it is not a recommended way to use Amazon S3."
I answered, "My client wants his eCommerce site's cache files to be generated in S3 storage. For this reason, cache folder of eCommerce site should be mounted the bucket."
John Rotenstein: "It will result in exactly the behaviour you describe."
Is there any alternative way to accomplish this requirement?
amazon-s3 amazon-ec2 s3fs
asked Mar 25 at 2:45
AgiloxAgilox
956923
I created S3 bucket and mounted with ec2. When I upload a file to S3 bucket, that file is copied to ec2 mounted folder automatically. I wanted the file to be uploaded to S3 bucket only. As it copies to EC2 folder, it becomes redundant and doesn't fulfill our requirements. I installed S3fs and executed the following commands:
sudo s3fs my-s3-bucket /var/www/html/vqmod/xml/ -o passwd_file=/home/ubuntu/.passwd-s3fs,nonempty,retries=5,gid=33,uid=33,allow_other,url=https://s3.amazonaws.com,umask=0000
Am I doing any permission mistake? Thanks.
Comments:
John Rotenstein: "Why do you wish to mount the bucket on the EC2 instance? Amazon S3 is an object storage system and is not designed to be "mounted". While there are utilities that can do this (eg s3fs), it is not a recommended way to use Amazon S3."
I answered, "My client wants his eCommerce site's cache files to be generated in S3 storage. For this reason, cache folder of eCommerce site should be mounted the bucket."
John Rotenstein: "It will result in exactly the behaviour you describe."
Is there any alternative way to accomplish this requirement?
amazon-s3 amazon-ec2 s3fs
amazon-s3 amazon-ec2 s3fs
asked Mar 25 at 2:45
AgiloxAgilox
956923
asked Mar 25 at 2:45
AgiloxAgilox
956923
edited Mar 26 at 6:11
Agilox
asked Mar 25 at 2:45
AgiloxAgilox
956923
asked Mar 25 at 2:45
AgiloxAgilox
956923
asked Mar 25 at 2:45
AgiloxAgilox
956923
956923
1
Why do you wish to mount the bucket on the EC2 instance? Amazon S3 is an object storage system and is not designed to be "mounted". While there are utilities that can do this (egs3fs), it is not a recommended way to use Amazon S3.
– John Rotenstein
Mar 25 at 3:11
My client wants his eCommerce site's cache files to be generated in S3 storage. For this reason, cache folder of eCommerce site should be mounted the bucket.
– Agilox
Mar 25 at 5:32
2
Why do they want that? It will result in exactly the behaviour you describe.
– John Rotenstein
Mar 25 at 5:40
Is it possible without mounting?
– Agilox
Mar 25 at 8:23
1
Are you sure the files are duplicated? Mountfing s3fs the files are visible as local, but actually residing in s3. That is what did you want to achieve, isn't it not?
– gusto2
Mar 25 at 8:25
|
show 1 more comment
1
Why do you wish to mount the bucket on the EC2 instance? Amazon S3 is an object storage system and is not designed to be "mounted". While there are utilities that can do this (egs3fs), it is not a recommended way to use Amazon S3.
– John Rotenstein
Mar 25 at 3:11
My client wants his eCommerce site's cache files to be generated in S3 storage. For this reason, cache folder of eCommerce site should be mounted the bucket.
– Agilox
Mar 25 at 5:32
2
Why do they want that? It will result in exactly the behaviour you describe.
– John Rotenstein
Mar 25 at 5:40
Is it possible without mounting?
– Agilox
Mar 25 at 8:23
1
Are you sure the files are duplicated? Mountfing s3fs the files are visible as local, but actually residing in s3. That is what did you want to achieve, isn't it not?
– gusto2
Mar 25 at 8:25
1
1
Why do you wish to mount the bucket on the EC2 instance? Amazon S3 is an object storage system and is not designed to be "mounted". While there are utilities that can do this (eg
s3fs), it is not a recommended way to use Amazon S3.– John Rotenstein
Mar 25 at 3:11
Why do you wish to mount the bucket on the EC2 instance? Amazon S3 is an object storage system and is not designed to be "mounted". While there are utilities that can do this (eg
s3fs), it is not a recommended way to use Amazon S3.– John Rotenstein
Mar 25 at 3:11
My client wants his eCommerce site's cache files to be generated in S3 storage. For this reason, cache folder of eCommerce site should be mounted the bucket.
– Agilox
Mar 25 at 5:32
My client wants his eCommerce site's cache files to be generated in S3 storage. For this reason, cache folder of eCommerce site should be mounted the bucket.
– Agilox
Mar 25 at 5:32
2
2
Why do they want that? It will result in exactly the behaviour you describe.
– John Rotenstein
Mar 25 at 5:40
Why do they want that? It will result in exactly the behaviour you describe.
– John Rotenstein
Mar 25 at 5:40
Is it possible without mounting?
– Agilox
Mar 25 at 8:23
Is it possible without mounting?
– Agilox
Mar 25 at 8:23
1
1
Are you sure the files are duplicated? Mountfing s3fs the files are visible as local, but actually residing in s3. That is what did you want to achieve, isn't it not?
– gusto2
Mar 25 at 8:25
Are you sure the files are duplicated? Mountfing s3fs the files are visible as local, but actually residing in s3. That is what did you want to achieve, isn't it not?
– gusto2
Mar 25 at 8:25
|
show 1 more comment
1 Answer
1
active
oldest
votes
File uploaded to s3 bucket are only visible in your s3fs mount path.
it does not take space on you fileSystem, when you open file then it downloads the content.
so in your case though they are visible on mounted path there are not on your system.
answered Apr 18 at 7:03
Manish KevreManish Kevre
1
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55330639%2fduplicate-on-both-s3-and-ec2-after-mounting%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
File uploaded to s3 bucket are only visible in your s3fs mount path.
it does not take space on you fileSystem, when you open file then it downloads the content.
so in your case though they are visible on mounted path there are not on your system.
answered Apr 18 at 7:03
Manish KevreManish Kevre
1
add a comment |
File uploaded to s3 bucket are only visible in your s3fs mount path.
it does not take space on you fileSystem, when you open file then it downloads the content.
so in your case though they are visible on mounted path there are not on your system.
answered Apr 18 at 7:03
Manish KevreManish Kevre
1
add a comment |
File uploaded to s3 bucket are only visible in your s3fs mount path.
it does not take space on you fileSystem, when you open file then it downloads the content.
so in your case though they are visible on mounted path there are not on your system.
answered Apr 18 at 7:03
Manish KevreManish Kevre
1
File uploaded to s3 bucket are only visible in your s3fs mount path.
it does not take space on you fileSystem, when you open file then it downloads the content.
so in your case though they are visible on mounted path there are not on your system.
answered Apr 18 at 7:03
Manish KevreManish Kevre
1
answered Apr 18 at 7:03
Manish KevreManish Kevre
1
answered Apr 18 at 7:03
Manish KevreManish Kevre
1
answered Apr 18 at 7:03
Manish KevreManish Kevre
1
1
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55330639%2fduplicate-on-both-s3-and-ec2-after-mounting%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
Why do you wish to mount the bucket on the EC2 instance? Amazon S3 is an object storage system and is not designed to be "mounted". While there are utilities that can do this (eg
s3fs), it is not a recommended way to use Amazon S3.– John Rotenstein
Mar 25 at 3:11
My client wants his eCommerce site's cache files to be generated in S3 storage. For this reason, cache folder of eCommerce site should be mounted the bucket.
– Agilox
Mar 25 at 5:32
2
Why do they want that? It will result in exactly the behaviour you describe.
– John Rotenstein
Mar 25 at 5:40
Is it possible without mounting?
– Agilox
Mar 25 at 8:23
1
Are you sure the files are duplicated? Mountfing s3fs the files are visible as local, but actually residing in s3. That is what did you want to achieve, isn't it not?
– gusto2
Mar 25 at 8:25