Cloudera Community
Announcements
Celebrating as our community reaches 100,000 members! Thank you!
manishsingh2k
user rank
Explorer

Re: [Closed] : How to store output of shell script...

by Explorer in Support Questions
‎02-07-2019 06:18 PM
‎02-07-2019 06:18 PM
Awesome!!! ... View more

Re: knox with yarnui - colon (:) character becomes...

by Explorer in Support Questions
‎12-21-2018 09:34 PM
‎12-21-2018 09:34 PM
@Kevin Risden Thank You. ... View more

Re: knox with yarnui - colon (:) character becomes...

by Explorer in Support Questions
‎12-14-2018 10:40 PM
‎12-14-2018 10:40 PM
Thank You Kevin. Unfortunately, an upgrade does not seem to be in the cards as of now. Would downloading the latest service directories containing the latest service and rewrite xml be able to fix it instead? ... View more

knox with yarnui - colon (:) character becomes %3A

by Explorer in Support Questions
‎12-14-2018 01:05 PM
‎12-14-2018 01:05 PM
Hi Experts, Please, any help in getting past this issue is appreciated. We are using HDP 2.6.1. Though KNOX with YARNUI is not officially supported, I thought I would give it a try by modifying the service and rewrite xml files a bit. It seems to be working fine except a few places. One of the issues that I am facing is that it is placing %3A instead of a colon (:) in the request URL. Here's the process flow. 1) Initial page - opens fine https://knox.sandbox.com:8443/gateway/default/yarn/ 2) Click on a finished Tez application - opens fine https://knox.sandbox.com:8443/gateway/default/yarn/cluster/app/application_1544594647974_0003 3) Click on logs - breaks. Here's what the link looks like. https://knox.sandbox.com:8443/gateway/default/yarn/nodemanager/node/containerlogs/container_e212_1544594647974_0003_01_000001/hive?host=datanode03.sandbox.com&port=8042 After clicking the link, the URL in the address bar becomes as below (Colon becomes %3A) http://rm.sandbox.com:19888/jobhistory/logs/datanode03.sandbox.com%3A45454/container_e212_1544594647974_0003_01_000001/container_e212_1544594647974_0003_01_000001/hive?doAs=myuser And the error shown on the web page is Cannot get container logs. Invalid nodeId: datanode03.sandbox.com%3A45454 Gateway log shows these lines 2018-12-14 03:51:26,968 DEBUG hadoop.gateway (UrlRewriteProcessor.java:rewrite(166)) - Rewrote URL: http://rm.sandbox.com:8088/proxy/application_1544594647974_0003/, direction: OUT via explicit rule: YARNUI/yarn/outbound/apps/history to URL: https://knox.sandbox.com:8443/gateway/default/yarn/proxy/application_1544594647974_0003 2018-12-14 03:51:26,969 DEBUG hadoop.gateway (UrlRewriteProcessor.java:rewrite(164)) - Rewrote URL: logs, direction: OUT via implicit rule: YARNUI/yarn/outbound/logs to URL: https://knox.sandbox.com:8443/gateway/default/yarn/logs 2018-12-14 03:51:26,970 DEBUG hadoop.gateway (UrlRewriteProcessor.java:rewrite(166)) - Rewrote URL: http://datanode03.sandbox.com:8042/node/containerlogs/container_e212_1544594647974_0003_01_000001/hive, direction: OUT via explicit rule: YARNUI/yarn/outbound/node/containerlogs to URL: https://knox.sandbox.com:8443/gateway/default/yarn/nodemanager/node/containerlogs/container_e212_1544594647974_0003_01_000001/hive?host=datanode03.sandbox.com&port=8042 2018-12-14 03:51:26,970 DEBUG hadoop.gateway (UrlRewriteProcessor.java:rewrite(166)) - Rewrote URL: /cluster/app, direction: OUT via explicit rule: YARNUI/yarn/outbound/apps/app to URL: https://knox.sandbox.com:8443/gateway/default/yarn/cluster/app 2018-12-14 03:52:47,645 DEBUG hadoop.gateway (GatewayFilter.java:doFilter(116)) - Received request: GET /yarn/nodemanager/node/containerlogs/container_e212_1544594647974_0003_01_000001/hive 2018-12-14 03:52:47,650 DEBUG hadoop.gateway (UrlRewriteProcessor.java:rewrite(164)) - Rewrote URL: https://knox.sandbox.com:8443/gateway/default/yarn/nodemanager/node/containerlogs/container_e212_1544594647974_0003_01_000001/hive?host=datanode03.sandbox.com&port=8042, direction: IN via implicit rule: YARNUI/yarn/inbound/node/containerlogs to URL: http://datanode03.sandbox.com:8042/node/containerlogs/container_e212_1544594647974_0003_01_000001/hive 2018-12-14 03:52:47,650 DEBUG hadoop.gateway (UrlRewriteProcessor.java:rewrite(164)) - Rewrote URL: https://knox.sandbox.com:8443/gateway/default/yarn/cluster/app/application_1544594647974_0003, direction: IN via implicit rule: YARNUI/yarn/inbound/cluster to URL: http://rm.sandbox.com:8088/cluster/app/application_1544594647974_0003 2018-12-14 03:52:47,650 DEBUG hadoop.gateway (DefaultDispatch.java:executeOutboundRequest(120)) - Dispatch request: GET http://datanode03.sandbox.com:8042/node/containerlogs/container_e212_1544594647974_0003_01_000001/hive?doAs=myuser 2018-12-14 03:52:47,666 DEBUG hadoop.gateway (DefaultDispatch.java:executeOutboundRequest(133)) - Dispatch response status: 307 2018-12-14 03:52:47,667 DEBUG hadoop.gateway (DefaultDispatch.java:getInboundResponseContentType(202)) - Using explicit character set UTF-8 for entity of type text/plain 2018-12-14 03:52:47,667 DEBUG hadoop.gateway (DefaultDispatch.java:getInboundResponseContentType(210)) - Inbound response entity content type: text/plain; charset=utf-8 ... View more
Labels:

Re: Hbase region server went down because of a JVM...

by Explorer in Support Questions
‎08-27-2018 03:42 PM
‎08-27-2018 03:42 PM
Were you able to find the cause of the issue? Thanks Manish ... View more

Re: How to remove an old HDP version

by Explorer in Support Questions
‎02-22-2018 11:18 PM
‎02-22-2018 11:18 PM
Did the mentioned script work for someone? I tried this today on Ambari 2.6.1 to remove HDP versions older than 2.3.4.0-3485. The command responded as "Accepted" and finished within a second. But, it didn't remove any packages from the nodes. Do I need to recycle the agents or something to trigger it? UPDATE:- It deleted the directory /usr/hdp/2.2.8.0-3150/ from all nodes and freed up disc space but, it didn't uninstall the rpm packages' entries. I had to do that manually. So, it kind of defeats the purpose. I guess manual rpm uninstall method is better than running this curl command to do a cleaner uninstall. ... View more

Re: How to Deregister Hiverserver2 from Zookeeper ...

by Explorer in Support Questions
‎02-01-2018 11:18 PM
‎02-01-2018 11:18 PM
Nevermind! Found a method to pull the hiveserver2 out of the zookeeper ensemble by deleting its znode using zookeeper client. Here's the info from MapR's website. ... View more

Re: How to Deregister Hiverserver2 from Zookeeper ...

by Explorer in Support Questions
‎02-01-2018 07:57 PM
‎02-01-2018 07:57 PM
hive --service hiveserver2 --deregister <Package ID> How do I find the package id for the hiveserver2? Thanks Manish ... View more

Re: ​Hive queries blocked - Tez always shows runni...

by Explorer in Support Questions
‎01-29-2018 04:22 PM
‎01-29-2018 04:22 PM
We are facing the same issue. Restarting the cluster doesn't seem to help either. Has anyone been able to figure out a way to clear those stale running queries? ... View more

Re: Hive JDBC client error when connecting to Kerb...

by Explorer in Support Questions
‎10-12-2017 02:08 PM
‎10-12-2017 02:08 PM
-Djavax.security.auth.useSubjectCredsOnly=false That solved the issue with beeline on our external host. Thank you very much. ... View more
Contact Me
Online
Offline
Last Visited
‎01-29-2023 02:58 PM
Community Statistics
Member Since ‎10-12-2017 02:06 PM
Last Visited ‎01-29-2023 02:58 PM
Posts 14