Python AWS S3FS API: Manually set proxy serverHow do you use an HTTP/HTTPS proxy with boto3?Difference between proxy server and reverse proxy serverGetting git to work with a proxy serverHow can I set an HTTP Proxy (WebProxy) on a WCF client-side Service proxy?How to set up Git to get through a proxyNode.js global proxy settingAccessing Node Proxy Server from a locally hosted fileCefSharp proxy-serverPython Proxy SettingsHow to provide proxy information to Twilio API with PythonSaltstack-2018.3 - s3fs mount using the fileserver_backend.conf is not working
Must a song using the A minor scale begin or end with an Am chord? If not, how can I tell what the scale is?
How likely is fragmentation on a table with 40000 products likely to affect performance
Incrementing add under condition in pandas
What do you call a flexible diving platform?
Are there any unpublished Iain M. Banks short stories?
What container to use to store developer concentrate?
Why would anyone ever invest in a cash-only etf?
What are the closest international airports in different countries?
Is there a wealth gap in Boston where the median net worth of white households is $247,500 while the median net worth for black families was $8?
Examples of simultaneous independent breakthroughs
Does dual boot harm a laptop battery or reduce its life?
How to store my pliers and wire cutters on my desk?
How many oliphaunts died in all of the Lord of the Rings battles?
Move the outer key inward in an association
Can I change the license of a forked project to the MIT if the license of the parent project has changed from the GPL to the MIT?
Struggling with cyclical dependancies in unit tests
How can religions be structured in ways that allow inter-faith councils to work?
Polyhedra, Polyhedron, Polytopes and Polygon
Dual-national, returning to US the day the US Passport expires; can he check in with airline on Dutch passport but reenter with expiring US passport?
Copying an existing HTML page and use it, is that against any copyright law?
Is it okay for me to decline a project on ethical grounds?
2 weeks and a tight budget to prepare for Z-day. How long can I hunker down?
Filter search results by multiple filters in one operation
How did the Axis intend to hold the Caucasus?
Python AWS S3FS API: Manually set proxy server
How do you use an HTTP/HTTPS proxy with boto3?Difference between proxy server and reverse proxy serverGetting git to work with a proxy serverHow can I set an HTTP Proxy (WebProxy) on a WCF client-side Service proxy?How to set up Git to get through a proxyNode.js global proxy settingAccessing Node Proxy Server from a locally hosted fileCefSharp proxy-serverPython Proxy SettingsHow to provide proxy information to Twilio API with PythonSaltstack-2018.3 - s3fs mount using the fileserver_backend.conf is not working
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
I can't set proxy server for S3FS Python API. As S3FS's Config class is imported from botocore there is no S3FS documentation about it. So, I have read this question and also botocore documentation.
However, I couldn't manage to get botocore Config class working with S3FS.
I have tried:
from s3fs.core import Config
proxy = Config(proxies='https':<my_proxy>)
fs = s3fs.S3FileSystem(key=MY_S3_KEY, secret=MY_S3_SECRET, config_kwargs=proxy)
fs.put(FILE_NAME, PATH)
I have also tried:
from s3fs.core import Config
fs = s3fs.S3FileSystem(key=MY_S3_KEY, secret=MY_S3_SECRET, config_kwargs=Config(proxies='https':<my_proxy>))
fs.put(FILE_NAME, PATH)
I have also tried to set same proxy for http. The proxy works fine from this computer, I have sucessfully tested several times from command line.
I always get Connection Timeout error message:
ConnectTimeoutError: Connect timeout on endpoint URL:....
Any suggestion is appreciated.
Thanks
python-3.x amazon-web-services proxy s3fs botocore
asked Mar 26 at 19:29
MarlosBMarlosB
308 bronze badges
add a comment |
I can't set proxy server for S3FS Python API. As S3FS's Config class is imported from botocore there is no S3FS documentation about it. So, I have read this question and also botocore documentation.
However, I couldn't manage to get botocore Config class working with S3FS.
I have tried:
from s3fs.core import Config
proxy = Config(proxies='https':<my_proxy>)
fs = s3fs.S3FileSystem(key=MY_S3_KEY, secret=MY_S3_SECRET, config_kwargs=proxy)
fs.put(FILE_NAME, PATH)
I have also tried:
from s3fs.core import Config
fs = s3fs.S3FileSystem(key=MY_S3_KEY, secret=MY_S3_SECRET, config_kwargs=Config(proxies='https':<my_proxy>))
fs.put(FILE_NAME, PATH)
I have also tried to set same proxy for http. The proxy works fine from this computer, I have sucessfully tested several times from command line.
I always get Connection Timeout error message:
ConnectTimeoutError: Connect timeout on endpoint URL:....
Any suggestion is appreciated.
Thanks
python-3.x amazon-web-services proxy s3fs botocore
asked Mar 26 at 19:29
MarlosBMarlosB
308 bronze badges
add a comment |
I can't set proxy server for S3FS Python API. As S3FS's Config class is imported from botocore there is no S3FS documentation about it. So, I have read this question and also botocore documentation.
However, I couldn't manage to get botocore Config class working with S3FS.
I have tried:
from s3fs.core import Config
proxy = Config(proxies='https':<my_proxy>)
fs = s3fs.S3FileSystem(key=MY_S3_KEY, secret=MY_S3_SECRET, config_kwargs=proxy)
fs.put(FILE_NAME, PATH)
I have also tried:
from s3fs.core import Config
fs = s3fs.S3FileSystem(key=MY_S3_KEY, secret=MY_S3_SECRET, config_kwargs=Config(proxies='https':<my_proxy>))
fs.put(FILE_NAME, PATH)
I have also tried to set same proxy for http. The proxy works fine from this computer, I have sucessfully tested several times from command line.
I always get Connection Timeout error message:
ConnectTimeoutError: Connect timeout on endpoint URL:....
Any suggestion is appreciated.
Thanks
python-3.x amazon-web-services proxy s3fs botocore
asked Mar 26 at 19:29
MarlosBMarlosB
308 bronze badges
I can't set proxy server for S3FS Python API. As S3FS's Config class is imported from botocore there is no S3FS documentation about it. So, I have read this question and also botocore documentation.
However, I couldn't manage to get botocore Config class working with S3FS.
I have tried:
from s3fs.core import Config
proxy = Config(proxies='https':<my_proxy>)
fs = s3fs.S3FileSystem(key=MY_S3_KEY, secret=MY_S3_SECRET, config_kwargs=proxy)
fs.put(FILE_NAME, PATH)
I have also tried:
from s3fs.core import Config
fs = s3fs.S3FileSystem(key=MY_S3_KEY, secret=MY_S3_SECRET, config_kwargs=Config(proxies='https':<my_proxy>))
fs.put(FILE_NAME, PATH)
I have also tried to set same proxy for http. The proxy works fine from this computer, I have sucessfully tested several times from command line.
I always get Connection Timeout error message:
ConnectTimeoutError: Connect timeout on endpoint URL:....
Any suggestion is appreciated.
Thanks
python-3.x amazon-web-services proxy s3fs botocore
python-3.x amazon-web-services proxy s3fs botocore
asked Mar 26 at 19:29
MarlosBMarlosB
308 bronze badges
asked Mar 26 at 19:29
MarlosBMarlosB
308 bronze badges
edited Mar 28 at 9:14
MarlosB
asked Mar 26 at 19:29
MarlosBMarlosB
308 bronze badges
asked Mar 26 at 19:29
MarlosBMarlosB
308 bronze badges
asked Mar 26 at 19:29
MarlosBMarlosB
308 bronze badges
308 bronze badges
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
Here are two ways to do it.
1 - Set an environment variable with the proxy:
os.environ['https_proxy'] = 'http://my_proxy_url'
s3 = s3fs.S3FileSystem(anon=False)
2 - pass in the proxy in the constructor:
s3 = s3fs.S3FileSystem(anon=False, config_kwargs='proxies': 'https': 'http://my_proxy_url')
answered May 6 at 14:29
user55295user55295
871 silver badge8 bronze badges
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55364919%2fpython-aws-s3fs-api-manually-set-proxy-server%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Here are two ways to do it.
1 - Set an environment variable with the proxy:
os.environ['https_proxy'] = 'http://my_proxy_url'
s3 = s3fs.S3FileSystem(anon=False)
2 - pass in the proxy in the constructor:
s3 = s3fs.S3FileSystem(anon=False, config_kwargs='proxies': 'https': 'http://my_proxy_url')
answered May 6 at 14:29
user55295user55295
871 silver badge8 bronze badges
add a comment |
Here are two ways to do it.
1 - Set an environment variable with the proxy:
os.environ['https_proxy'] = 'http://my_proxy_url'
s3 = s3fs.S3FileSystem(anon=False)
2 - pass in the proxy in the constructor:
s3 = s3fs.S3FileSystem(anon=False, config_kwargs='proxies': 'https': 'http://my_proxy_url')
answered May 6 at 14:29
user55295user55295
871 silver badge8 bronze badges
add a comment |
Here are two ways to do it.
1 - Set an environment variable with the proxy:
os.environ['https_proxy'] = 'http://my_proxy_url'
s3 = s3fs.S3FileSystem(anon=False)
2 - pass in the proxy in the constructor:
s3 = s3fs.S3FileSystem(anon=False, config_kwargs='proxies': 'https': 'http://my_proxy_url')
answered May 6 at 14:29
user55295user55295
871 silver badge8 bronze badges
Here are two ways to do it.
1 - Set an environment variable with the proxy:
os.environ['https_proxy'] = 'http://my_proxy_url'
s3 = s3fs.S3FileSystem(anon=False)
2 - pass in the proxy in the constructor:
s3 = s3fs.S3FileSystem(anon=False, config_kwargs='proxies': 'https': 'http://my_proxy_url')
answered May 6 at 14:29
user55295user55295
871 silver badge8 bronze badges
answered May 6 at 14:29
user55295user55295
871 silver badge8 bronze badges
answered May 6 at 14:29
user55295user55295
871 silver badge8 bronze badges
answered May 6 at 14:29
user55295user55295
871 silver badge8 bronze badges
871 silver badge8 bronze badges
add a comment |
add a comment |
Got a question that you can’t ask on public Stack Overflow? Learn more about sharing private information with Stack Overflow for Teams.
Got a question that you can’t ask on public Stack Overflow? Learn more about sharing private information with Stack Overflow for Teams.
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55364919%2fpython-aws-s3fs-api-manually-set-proxy-server%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
