Support Questions

ads · ‎12-17-2015

I'm running though "Securing your Hadoop Infrastructure with Apache Knox." I've installed HDP 2.3 and have been following the steps described. I can run step 6, accessing the Hadoop Cluster via WebHDFS. But step 7, accessing the Hadopp Cluster via the Apache Know Gateway fails.

curl -iku guest:guest-password -X GET 'https://localhost:8443/gateway/sandbox/webhdfs/v1/?op=LISTSTATUS'

HTTP/1.1 404 Not Found Cache-Control: must-revalidate,no-cache,no-store Content-Type: text/html;charset=ISO-8859-1 Content-Length: 1294 Server: Jetty(8.1.14.v20131031) <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 Not Found</title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /gateway/sandbox/webhdfs/v1/. Reason: <pre> Not Found</pre></p> <hr /><i><small>Powered by Jetty://</small></i> </body> </html>

All the requisite processes seem to be running. I have no clue what to look at to get this working.

nsabharwal · ‎12-17-2015

@Christopher Lewis

Try this

curl -iv -k -u guest:guest-password https://sandbox:8443/gateway/default/webhdfs/v1/?op=LISTSTATUS

View solution in original post

nsabharwal · ‎12-17-2015

@Christopher Lewis

what's the output of curl -iku guest:guest-password -X GET 'http://sandbox:50070/webhdfs/v1/?op=LISTSTATUS' ?

kevin_minder · ‎12-17-2015

If you've installed Knox via Ambari the topology name used is default instead of sandbox so try this command.

curl -iku guest:guest-password -X GET 'https://localhost:8443/gateway/default/webhdfs/v1/?op=LISTSTATUS'

ads · ‎12-17-2015

No, I am using the Knox included with the HDP image. If I try using <default> I get:

[root@sandbox ~]# curl -iku guest:guest-password -X GET 'https://localhost:8443/gateway/default/webhdfs/v1/?op=LISTSTATUS' HTTP/1.1 401 Unauthorized WWW-Authenticate: BASIC realm="application" Content-Length: 0 Server: Jetty(8.1.14.v20131031)

nsabharwal · ‎12-17-2015

It's working at my end.

kevin_minder · ‎12-17-2015

@Christopher Lewis < This looks like progress. I'm guessing the Demo LDAP server isn't running on your VM.

nsabharwal · ‎12-17-2015

@Kevin Minder Tutorial has errors

curl -iku guest:guest-password -X GET 'https://localhost:8443/gateway/sandbox/webhdfs/v1/?op=LISTSTATUS'

http://hortonworks.com/hadoop-tutorial/securing-hadoop-infrastructure-apache-knox/

beingmeus · ‎01-15-2016

It worked for me. Thanks for the advise

I wonder if HWX does this deliberately, so are we forced to venture into the dark space (so, we learn more) which we wouldn't otherwise 🙂

ads · ‎12-17-2015

[root@sandbox ~]# curl -iku guest:guest-password -X GET 'http://sandbox:50070/webhdfs/v1/?op=LISTSTATUS' HTTP/1.1 200 OK Cache-Control: no-cache Expires: Thu, 17 Dec 2015 03:01:16 GMT Date: Thu, 17 Dec 2015 03:01:16 GMT Pragma: no-cache Expires: Thu, 17 Dec 2015 03:01:16 GMT Date: Thu, 17 Dec 2015 03:01:16 GMT Pragma: no-cache Content-Type: application/json Transfer-Encoding: chunked Server: Jetty(6.1.26.hwx)

nsabharwal · ‎12-17-2015

@Christopher Lewis

Try this

curl -iv -k -u guest:guest-password https://sandbox:8443/gateway/default/webhdfs/v1/?op=LISTSTATUS

ads · ‎12-17-2015

Thank you both for your help. I restarted the Knox LDAP manually instead of with Ambari and used the default path instead of sandbox. I can get connected now.

@Neeraj Sabharwal

@Kevin Minder

Amryz5 · ‎04-04-2018

how you restarted the Knox LDAP ???

rkandula · ‎12-13-2016

Need to start Demo LDAP from service actions in order to test the test accounts with out LDAP integration

v-weilwu · ‎09-28-2018

I'm having the same issue!

https://knox.apache.org/books/knox-1-1-0/user-guide.html#Quick+Start

Following the tutorial step by step and the I get this:

root@hn0-securi:~/knox-1.1.0# curl -i -k -u guest:guest-password -X GET 'https://localhost:8443/gateway/sandbox/webhdfs/v1/?op=LISTSTATUS' HTTP/1.1 500 Server Error Date: Thu, 27 Sep 2018 07:45:22 GMT Set-Cookie: JSESSIONID=5qbve5zzilryrp6nfy8zztn0;Path=/gateway/sandbox;Secure;HttpOnly Set-Cookie: rememberMe=deleteMe; Path=/gateway/sandbox; Max-Age=0; Expires=Wed, 26-Sep-2018 07:45:22 GMT Content-Type: text/html; charset=ISO-8859-1 Cache-Control: must-revalidate,no-cache,no-store Content-Length: 317 Connection: close Server: Jetty(9.2.22.v20170606) <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/> <title>Error 500 Server Error</title> </head> <body><h2>HTTP ERROR 500</h2> <p>Problem accessing /gateway/sandbox/webhdfs/v1/. Reason: <pre> Server Error</pre></p><hr><i><small>Powered by Jetty://</small></i><hr/> </body> </html>

Please help !!

Thanks

Support Questions

Tutorial Issue: Can't connect to HDFS through the Knox Gateway