WebHDFS + Kerberos IllegalArgumentException on curl requestWhy does a browser in a different domain not respond at all to “WWW Authenticate : Negotiate” header sent by mod_auth_kerb?How to use UserGroupInformation with Kerberos WebHDFSHTTP/1.1 401 Access to the HttpFS server is restrictedAccessing kerberos secured webhdfs from browserDocker Kerberos WebHDFS AuthenticationException: UnauthorizedGetting GSSException: Defective token detected error while calling HDFS API on a kerberised clusterAPI Connection using Python requests_kerberoswebhdfs is redirecting to localhost:50075TD-AGENT + WebHDFS + kerberos = error “webhdfs check request failed”JMeter call to kerberos protected rest api fails (works from IE browser)
CDG baggage claim before or after immigration?
Algorithm that spans orthogonal vectors: Python
A high quality contribution but an annoying error is present in my published article
Cut a cake into 3 equal portions with only a knife
Would Taiwan and China's dispute be solved if Taiwan gave up being the Republic of China?
How can I repair this gas leak on my new range? Teflon tape isn't working
Hedging EURUSD with negative rates
How to deal with my team leader who keeps calling me about project updates even though I am on leave for personal reasons?
Selecting ARIMA orders based on ACF-PACF vs. auto.arima
How does IBM's 53-bit quantum computer compare to classical ones for cryptanalytic tasks?
Did Apollo carry and use WD40?
Leaving a job that I just took based on false promise of a raise. What do I tell future interviewers?
What is the relationship between 友だち, 恋人, and 仲良し in this dialog?
Should I complain to HR about being mocked for request I made
To what extent is it worthwhile to report check fraud / refund scams?
Where does an unaligned creature's soul go after death?
Can the U.S. president make military decisions without consulting anyone?
delete object network in cisco ASA with packet tracert
When does removing Goblin Warchief affect its cost reduction ability?
What are the benefits and disadvantages if a creature has multiple tails, e.g., Kyuubi or Nekomata?
What was an "insurance cover"?
How does one calculate the distribution of the Matt Colville way of rolling stats?
Is it more effective to add yeast before or after kneading?
I reverse the source code, you negate the output!
WebHDFS + Kerberos IllegalArgumentException on curl request
Why does a browser in a different domain not respond at all to “WWW Authenticate : Negotiate” header sent by mod_auth_kerb?How to use UserGroupInformation with Kerberos WebHDFSHTTP/1.1 401 Access to the HttpFS server is restrictedAccessing kerberos secured webhdfs from browserDocker Kerberos WebHDFS AuthenticationException: UnauthorizedGetting GSSException: Defective token detected error while calling HDFS API on a kerberised clusterAPI Connection using Python requests_kerberoswebhdfs is redirecting to localhost:50075TD-AGENT + WebHDFS + kerberos = error “webhdfs check request failed”JMeter call to kerberos protected rest api fails (works from IE browser)
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
I'm trying to make curl webhdfs work since I configured kerberos on my HDB Cluster.
What I'm getting if I not create a kerberos ticket is an authentication error.
Once I created the ticket then the message raised is a java IllegalArgumentException
And I'm connecting from a Windows machine and I'm able to see a valid kerberos ticket on the MIT Kerberos Ticket Manager.
I'm using this command against active namenode IP:
kinit -kt hdfs.headless.keytab hdfs && curl -k -i --negotiate -u : "http://X.X.X.X:50070/webhdfs/v1/user?op=LISTSTATUS"
This is the response from the server (There are two response, the first is to negotiate the kerberos auth I guess) :
HTTP/1.1 401 Authentication required
Date: Thu, 28 Mar 2019 15:30:29 GMT
Date: Thu, 28 Mar 2019 15:30:29 GMT
Pragma: no-cache
X-FRAME-OPTIONS: SAMEORIGIN
WWW-Authenticate: Negotiate
Set-Cookie: hadoop.auth=; Path=/; HttpOnly
Cache-Control: must-revalidate,no-cache,no-store
Content-Type: text/html;charset=iso-8859-1
Content-Length: 275
HTTP/1.1 403 java.lang.IllegalArgumentException
Date: Thu, 28 Mar 2019 15:30:29 GMT
Date: Thu, 28 Mar 2019 15:30:29 GMT
Pragma: no-cache
X-FRAME-OPTIONS: SAMEORIGIN
Set-Cookie: hadoop.auth=; Path=/; HttpOnly
Cache-Control: must-revalidate,no-cache,no-store
Content-Type: text/html;charset=iso-8859-1
Content-Length: 297
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 403 java.lang.IllegalArgumentException</title>
</head>
<body><h2>HTTP ERROR 403</h2>
<p>Problem accessing /webhdfs/v1/user. Reason:
<pre> java.lang.IllegalArgumentException</pre></p>
</body>
</html>
If I make this recuest from a Cent OS machine from my HDP cluster it is working properly, so I think there is something wrong either in my request or my kerberos configuration.
By the way, I can't find webhdfs logs to see more information about the exception (I looked in /var/log/hadoop/hdfs...) inside the namenode. I can't use the Web UI to see the HDFS logs because it is broken with the same exception when I try to access from the browser.
Thank you
windows kerberos webhdfs hdp
asked Mar 28 at 15:39
dhalfagemedhalfageme
4201 gold badge5 silver badges21 bronze badges
add a comment
|
I'm trying to make curl webhdfs work since I configured kerberos on my HDB Cluster.
What I'm getting if I not create a kerberos ticket is an authentication error.
Once I created the ticket then the message raised is a java IllegalArgumentException
And I'm connecting from a Windows machine and I'm able to see a valid kerberos ticket on the MIT Kerberos Ticket Manager.
I'm using this command against active namenode IP:
kinit -kt hdfs.headless.keytab hdfs && curl -k -i --negotiate -u : "http://X.X.X.X:50070/webhdfs/v1/user?op=LISTSTATUS"
This is the response from the server (There are two response, the first is to negotiate the kerberos auth I guess) :
HTTP/1.1 401 Authentication required
Date: Thu, 28 Mar 2019 15:30:29 GMT
Date: Thu, 28 Mar 2019 15:30:29 GMT
Pragma: no-cache
X-FRAME-OPTIONS: SAMEORIGIN
WWW-Authenticate: Negotiate
Set-Cookie: hadoop.auth=; Path=/; HttpOnly
Cache-Control: must-revalidate,no-cache,no-store
Content-Type: text/html;charset=iso-8859-1
Content-Length: 275
HTTP/1.1 403 java.lang.IllegalArgumentException
Date: Thu, 28 Mar 2019 15:30:29 GMT
Date: Thu, 28 Mar 2019 15:30:29 GMT
Pragma: no-cache
X-FRAME-OPTIONS: SAMEORIGIN
Set-Cookie: hadoop.auth=; Path=/; HttpOnly
Cache-Control: must-revalidate,no-cache,no-store
Content-Type: text/html;charset=iso-8859-1
Content-Length: 297
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 403 java.lang.IllegalArgumentException</title>
</head>
<body><h2>HTTP ERROR 403</h2>
<p>Problem accessing /webhdfs/v1/user. Reason:
<pre> java.lang.IllegalArgumentException</pre></p>
</body>
</html>
If I make this recuest from a Cent OS machine from my HDP cluster it is working properly, so I think there is something wrong either in my request or my kerberos configuration.
By the way, I can't find webhdfs logs to see more information about the exception (I looked in /var/log/hadoop/hdfs...) inside the namenode. I can't use the Web UI to see the HDFS logs because it is broken with the same exception when I try to access from the browser.
Thank you
windows kerberos webhdfs hdp
asked Mar 28 at 15:39
dhalfagemedhalfageme
4201 gold badge5 silver badges21 bronze badges
For the record, when you start a WebHDFS session, you typically issue a "get delegation token" request. That token works like a session cookie, except you have to insert it in your next URLs -- and you can remove the Kerberos options.
– Samson Scharfrichter
Mar 29 at 8:27
add a comment
|
I'm trying to make curl webhdfs work since I configured kerberos on my HDB Cluster.
What I'm getting if I not create a kerberos ticket is an authentication error.
Once I created the ticket then the message raised is a java IllegalArgumentException
And I'm connecting from a Windows machine and I'm able to see a valid kerberos ticket on the MIT Kerberos Ticket Manager.
I'm using this command against active namenode IP:
kinit -kt hdfs.headless.keytab hdfs && curl -k -i --negotiate -u : "http://X.X.X.X:50070/webhdfs/v1/user?op=LISTSTATUS"
This is the response from the server (There are two response, the first is to negotiate the kerberos auth I guess) :
HTTP/1.1 401 Authentication required
Date: Thu, 28 Mar 2019 15:30:29 GMT
Date: Thu, 28 Mar 2019 15:30:29 GMT
Pragma: no-cache
X-FRAME-OPTIONS: SAMEORIGIN
WWW-Authenticate: Negotiate
Set-Cookie: hadoop.auth=; Path=/; HttpOnly
Cache-Control: must-revalidate,no-cache,no-store
Content-Type: text/html;charset=iso-8859-1
Content-Length: 275
HTTP/1.1 403 java.lang.IllegalArgumentException
Date: Thu, 28 Mar 2019 15:30:29 GMT
Date: Thu, 28 Mar 2019 15:30:29 GMT
Pragma: no-cache
X-FRAME-OPTIONS: SAMEORIGIN
Set-Cookie: hadoop.auth=; Path=/; HttpOnly
Cache-Control: must-revalidate,no-cache,no-store
Content-Type: text/html;charset=iso-8859-1
Content-Length: 297
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 403 java.lang.IllegalArgumentException</title>
</head>
<body><h2>HTTP ERROR 403</h2>
<p>Problem accessing /webhdfs/v1/user. Reason:
<pre> java.lang.IllegalArgumentException</pre></p>
</body>
</html>
If I make this recuest from a Cent OS machine from my HDP cluster it is working properly, so I think there is something wrong either in my request or my kerberos configuration.
By the way, I can't find webhdfs logs to see more information about the exception (I looked in /var/log/hadoop/hdfs...) inside the namenode. I can't use the Web UI to see the HDFS logs because it is broken with the same exception when I try to access from the browser.
Thank you
windows kerberos webhdfs hdp
asked Mar 28 at 15:39
dhalfagemedhalfageme
4201 gold badge5 silver badges21 bronze badges
I'm trying to make curl webhdfs work since I configured kerberos on my HDB Cluster.
What I'm getting if I not create a kerberos ticket is an authentication error.
Once I created the ticket then the message raised is a java IllegalArgumentException
And I'm connecting from a Windows machine and I'm able to see a valid kerberos ticket on the MIT Kerberos Ticket Manager.
I'm using this command against active namenode IP:
kinit -kt hdfs.headless.keytab hdfs && curl -k -i --negotiate -u : "http://X.X.X.X:50070/webhdfs/v1/user?op=LISTSTATUS"
This is the response from the server (There are two response, the first is to negotiate the kerberos auth I guess) :
HTTP/1.1 401 Authentication required
Date: Thu, 28 Mar 2019 15:30:29 GMT
Date: Thu, 28 Mar 2019 15:30:29 GMT
Pragma: no-cache
X-FRAME-OPTIONS: SAMEORIGIN
WWW-Authenticate: Negotiate
Set-Cookie: hadoop.auth=; Path=/; HttpOnly
Cache-Control: must-revalidate,no-cache,no-store
Content-Type: text/html;charset=iso-8859-1
Content-Length: 275
HTTP/1.1 403 java.lang.IllegalArgumentException
Date: Thu, 28 Mar 2019 15:30:29 GMT
Date: Thu, 28 Mar 2019 15:30:29 GMT
Pragma: no-cache
X-FRAME-OPTIONS: SAMEORIGIN
Set-Cookie: hadoop.auth=; Path=/; HttpOnly
Cache-Control: must-revalidate,no-cache,no-store
Content-Type: text/html;charset=iso-8859-1
Content-Length: 297
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 403 java.lang.IllegalArgumentException</title>
</head>
<body><h2>HTTP ERROR 403</h2>
<p>Problem accessing /webhdfs/v1/user. Reason:
<pre> java.lang.IllegalArgumentException</pre></p>
</body>
</html>
If I make this recuest from a Cent OS machine from my HDP cluster it is working properly, so I think there is something wrong either in my request or my kerberos configuration.
By the way, I can't find webhdfs logs to see more information about the exception (I looked in /var/log/hadoop/hdfs...) inside the namenode. I can't use the Web UI to see the HDFS logs because it is broken with the same exception when I try to access from the browser.
Thank you
windows kerberos webhdfs hdp
windows kerberos webhdfs hdp
asked Mar 28 at 15:39
dhalfagemedhalfageme
4201 gold badge5 silver badges21 bronze badges
asked Mar 28 at 15:39
dhalfagemedhalfageme
4201 gold badge5 silver badges21 bronze badges
edited Mar 28 at 15:51
dhalfageme
asked Mar 28 at 15:39
dhalfagemedhalfageme
4201 gold badge5 silver badges21 bronze badges
asked Mar 28 at 15:39
dhalfagemedhalfageme
4201 gold badge5 silver badges21 bronze badges
asked Mar 28 at 15:39
dhalfagemedhalfageme
4201 gold badge5 silver badges21 bronze badges
4201 gold badge5 silver badges21 bronze badges
For the record, when you start a WebHDFS session, you typically issue a "get delegation token" request. That token works like a session cookie, except you have to insert it in your next URLs -- and you can remove the Kerberos options.
– Samson Scharfrichter
Mar 29 at 8:27
add a comment
|
For the record, when you start a WebHDFS session, you typically issue a "get delegation token" request. That token works like a session cookie, except you have to insert it in your next URLs -- and you can remove the Kerberos options.
– Samson Scharfrichter
Mar 29 at 8:27
For the record, when you start a WebHDFS session, you typically issue a "get delegation token" request. That token works like a session cookie, except you have to insert it in your next URLs -- and you can remove the Kerberos options.
– Samson Scharfrichter
Mar 29 at 8:27
For the record, when you start a WebHDFS session, you typically issue a "get delegation token" request. That token works like a session cookie, except you have to insert it in your next URLs -- and you can remove the Kerberos options.
– Samson Scharfrichter
Mar 29 at 8:27
add a comment
|
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/4.0/"u003ecc by-sa 4.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55401630%2fwebhdfs-kerberos-illegalargumentexception-on-curl-request%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55401630%2fwebhdfs-kerberos-illegalargumentexception-on-curl-request%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
For the record, when you start a WebHDFS session, you typically issue a "get delegation token" request. That token works like a session cookie, except you have to insert it in your next URLs -- and you can remove the Kerberos options.
– Samson Scharfrichter
Mar 29 at 8:27