Member since
10-30-2016
20
Posts
1
Kudos Received
0
Solutions
03-13-2018
12:12 PM
We have already configured HA for RESOURCEMANAGER in Hadoop. It is working fine. . We have included the following ---config in knox topology(topology1) to support HA . ------------ <role>ha</role>
<name>HaProvider</name>
<enabled>true</enabled>
<param>
<name>WEBHDFS</name>
<value>maxFailoverAttempts=3;failoverSleep=1000;maxRetryAttempts=300;retrySleep=3000;enabled=true</value>
</param>
<param>
<name>RESOURCEMANAGER</name>
<value>maxFailoverAttempts=3;failoverSleep=1000;maxRetryAttempts=300;retrySleep=3000;enabled=true</value>
</param> ---------- ------- <service>
<role>RESOURCEMANAGER</role> <url>http://rmhost1:8088/ws</url>
<url>http://rmhost2::8088/ws</url>
</service> ------- The below command is working fine when the rmhost1 is active resourcemanager. curl -ivk -u narasik "http://knoxhost:8443/knox/topology1/resourcemanager/v1/cluster" But it is failing when the rmhost2 is active resoucemanger. The error details are as below. ========================== Enter host password for user 'narasik':
* About to connect() to knoxhost port 8443 (#0)
* Trying 53.20.25.82... connected
*Connected to knoxhost port 8443 (#0)
* Server auth using Basic with user 'narasik'
> GET /knox/topology1/resourcemanager/v1/cluster HTTP/1.1
> Authorization: Basic ZWVkY19hX25hcmFzaWs6S2FuYXB1cmFAMDYwNDE5Nzc=
> User-Agent: curl/7.19.7 (x86_64-suse-linux-gnu) libcurl/7.19.7 OpenSSL/0.9.8j zlib/1.2.7 libidn/1.10 > Host: knoxhost:8443 > Accept: */* > < HTTP/1.1 307 Temporary Redirect HTTP/1.1 307 Temporary Redirect
< Date: Tue, 13 Mar 2018 11:24:42 GMT Date: Tue, 13 Mar 2018 11:24:42 GMT < Set-Cookie: JSESSIONID=1iup958ngi2i01ift6v8d6sbst;Path=/knox/topology;Secure;HttpOnly Set-Cookie: JSESSIONID=1iup958ngi2i01ift6v8d6sbst;Path=/knox/topology1;Secure;HttpOnly < Expires: Thu, 01 Jan 1970 00:00:00 GMT
Expires: Thu, 01 Jan 1970 00:00:00 GMT < Set-Cookie: rememberMe=deleteMe; Path=/knox/topology1; Max-Age=0; Expires=Mon, 12-Mar-2018 11:24:42 GMT
Set-Cookie: rememberMe=deleteMe; Path=/knox/topology1; Max-Age=0; Expires=Mon, 12-Mar-2018 11:24:42 GMT
< Cache-Control: no-cache Cache-Control: no-cache
< Expires: Tue, 13 Mar 2018 11:24:42 GMT
Expires: Tue, 13 Mar 2018 11:24:42 GMT < Date: Tue, 13 Mar 2018 11:24:42 GMT Date: Tue, 13 Mar 2018 11:24:42 GMT < Pragma: no-cache Pragma: no-cache < Expires: Tue, 13 Mar 2018 11:24:42 GMT Expires: Tue, 13 Mar 2018 11:24:42 GMT < Date: Tue, 13 Mar 2018 11:24:42 GMT Date: Tue, 13 Mar 2018 11:24:42 GMT < Pragma: no-cache Pragma: no-cache < Content-Type: text/plain; charset=UTF-8
Content-Type: text/plain; charset=UTF-8 < X-Frame-Options: SAMEORIGIN
X-Frame-Options: SAMEORIGIN < Location: http://rmhost2:8088/ws/v1/cluster/?doAs=narasik
Location: http://rmhost2:8088/ws/v1/cluster/?doAs=narasik
< Server: Jetty(6.1.26.hwx)
Server: Jetty(6.1.26.hwx) < Content-Length: 77
Content-Length: 77 < This is standby RM. The redirect url is: /ws/v1/cluster/?doAs=narasik * Connection #0 to host knox host left intact * Closing connection #0 ==========================
... View more
Labels:
- Labels:
-
Apache Knox
-
Cloudera Manager
02-26-2018
11:14 AM
we are using standalone ambari view server with version 2.4.0.11. As per business requirement, we need to disable the upload buttone on the ambari file view. Please let us know how to disable.
... View more
Labels:
- Labels:
-
Apache Ambari
10-16-2017
01:21 PM
I am getting the following error. I have tried to kinit with NIFI user and restarted the Nifi. It does not help. Please help me to resolve the issue. ============== 2017-10-16 14:23:48,160 ERROR [Timer-Driven Process Thread-3] o.a.nifi.processors.hive.SelectHiveQL SelectHiveQL[id=03b64b0c-9c12-1ff8-2386-7ae51c0c77d4] Unable to execute HiveQL select query select * from xyz where name='CIF' and BOD='2009-12-09' due to org.apache.nifi.processor.exception.ProcessException: java.sql.SQLException: org.apache.thrift.transport.TTransportException: org.apache.http.client.ClientProtocolException; routing to failure: {}
org.apache.nifi.processor.exception.ProcessException: java.sql.SQLException: org.apache.thrift.transport.TTransportException: org.apache.http.client.ClientProtocolException
at org.apache.nifi.processors.hive.SelectHiveQL$2.process(SelectHiveQL.java:305)
at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2529)
at org.apache.nifi.processors.hive.SelectHiveQL.onTrigger(SelectHiveQL.java:275)
at org.apache.nifi.processors.hive.SelectHiveQL.lambda$onTrigger$0(SelectHiveQL.java:215)
at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114)
at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:106)
at org.apache.nifi.processors.hive.SelectHiveQL.onTrigger(SelectHiveQL.java:215)
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1118)
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.sql.SQLException: org.apache.thrift.transport.TTransportException: org.apache.http.client.ClientProtocolException
at org.apache.hive.jdbc.HiveStatement.runAsyncOnServer(HiveStatement.java:308)
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:241)
at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:437)
at org.apache.commons.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
at org.apache.commons.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
at org.apache.nifi.processors.hive.SelectHiveQL$2.process(SelectHiveQL.java:293)
... 17 common frames omitted Caused by: org.apache.thrift.transport.TTransportException: org.apache.http.client.ClientProtocolException
at org.apache.thrift.transport.THttpClient.flushUsingHttpClient(THttpClient.java:297)
at org.apache.thrift.transport.THttpClient.flush(THttpClient.java:313)
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73)
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62)
at org.apache.hive.service.cli.thrift.TCLIService$Client.send_ExecuteStatement(TCLIService.java:223)
at org.apache.hive.service.cli.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:215)
at sun.reflect.GeneratedMethodAccessor72.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hive.jdbc.HiveConnection$SynchronizedHandler.invoke(HiveConnection.java:1374)
at com.sun.proxy.$Proxy129.ExecuteStatement(Unknown Source)
at org.apache.hive.jdbc.HiveStatement.runAsyncOnServer(HiveStatement.java:299)
... 22 common frames omitted
Caused by: org.apache.http.client.ClientProtocolException: null
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:187)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:118)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.thrift.transport.THttpClient.flushUsingHttpClient(THttpClient.java:251)
... 33 common frames omitted
Caused by: org.apache.http.HttpException: null
at org.apache.hive.jdbc.HttpRequestInterceptorBase.process(HttpRequestInterceptorBase.java:86)
at org.apache.http.protocol.ImmutableHttpProcessor.process(ImmutableHttpProcessor.java:132)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:183)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.ServiceUnavailableRetryExec.execute(ServiceUnavailableRetryExec.java:85)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
... 36 common frames omitted
Caused by: org.apache.http.HttpException: null
at org.apache.hive.jdbc.HttpKerberosRequestInterceptor.addHttpAuthHeader(HttpKerberosRequestInterceptor.java:68)
at org.apache.hive.jdbc.HttpRequestInterceptorBase.process(HttpRequestInterceptorBase.java:74)
... 42 common frames omitted
Caused by: java.lang.reflect.UndeclaredThrowableException: null
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1884)
at org.apache.hive.service.auth.HttpAuthUtils.getKerberosServiceTicket(HttpAuthUtils.java:83)
at org.apache.hive.jdbc.HttpKerberosRequestInterceptor.addHttpAuthHeader(HttpKerberosRequestInterceptor.java:62)
... 43 common frames omitted
Caused by: org.ietf.jgss.GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:122)
at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187)
at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:224)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179)
at org.apache.hive.service.auth.HttpAuthUtils$HttpKerberosClientAction.run(HttpAuthUtils.java:183)
at org.apache.hive.service.auth.HttpAuthUtils$HttpKerberosClientAction.run(HttpAuthUtils.java:151)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
... 45 common frames omitted ==================
... View more
Labels:
- Labels:
-
Apache NiFi
08-11-2017
12:09 PM
@Venkat, I have delete the alert from ambari.alert_current table. But this alert row is created after couple of minutes and the alert is present on the ambari. Please help me any other ideas to resolve this issue. Thanks Narasimha k.
... View more
08-11-2017
10:35 AM
@Venkat, I have delete the alert from ambari.alert_current table. But this alert row is created after couple of minutes and the alert is present on the ambari. Please help me any other ideas to resolve this issue. Thanks Narasimha k.
... View more
08-11-2017
06:30 AM
@Venkat, I have already checked . Only one RM process is running. Please help me any other ideas to resolve this issue. root@xxxxxxxxxnnnn:/root : jps -l | grep -i resourcemanager 11550 org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
... View more
08-10-2017
03:45 PM
@Geoffrey Shelton Okot, I am facing this issue since last two days. I have deactivated and activated the state of this alert. But no luck. The alert is triggered after couple of minutes. Please help me.
... View more
08-10-2017
12:17 PM
We are getting the altert with the following response details. Even though the web UI is working accessible. I am using HDP 2.5. Please help me to resolved the altert. HTTP 401 response from http://xxxxxxxxnnnn.aaaa.bbb..corpintra.net:8088 in 0.000s ( % Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 43 0 43 0 0 16468 0 --:--:-- --:--:-- --:--:-- 43000
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 1400 100 1400 0 0 179k 0 --:--:-- --:--:-- --:--:-- 179k
100 1400 100 1400 0 0 156k 0 --:--:-- --:--:-- --:--:-- 156k)
... View more
- Tags:
- Hadoop Core
- YARN
Labels:
- Labels:
-
Apache YARN
06-10-2017
12:31 PM
Ambari infra solr is used for ranger audits for indexing in my project cluster . currently we are facing disk issue on ambari infra sever. Client requested to remove the audits older than two months to make free space on on server.
Any body knows how to remove the audits data index on ambari infra solr instance server.
... View more
Labels:
- Labels:
-
Apache Ambari
04-03-2017
05:42 PM
H Mugdha, Permissions 775 is already set for /tmp/hive/operation_logs. The issue is not resolved. Thanks Narasimha K.
... View more
03-31-2017
06:42 AM
When I run the query " Show tables;". It is giving the follwoing error message. Please help me to fix the issue. Couldn't find log associated with operation handle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=0e52b4d0-4859-4a34-ba6c-00d78516ece4]
... View more
Labels:
- Labels:
-
Cloudera Hue
03-09-2017
10:40 AM
We are getting the following error after starting the nimbus service. Please help us. 2017-03-07 16:13:21.001 o.a.s.s.o.a.z.ClientCnxn [ERROR] SASL authentication with Zookeeper Quorum member failed: javax.security.sasl.SaslException: An error: (java.sec
urity.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Connect
ion refused)]) occurred when evaluating Zookeeper Quorum Member's received SASL token. Zookeeper Client will go to AUTH_FAILED state.
2017-03-07 16:13:21.001 o.a.s.s.o.a.c.ConnectionState [ERROR] Authentication failed
2017-03-07 16:13:21.104 o.a.s.d.nimbus [ERROR] Error when processing event
java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: org.apache.storm.shade.org.apache.zookeeper.KeeperException$AuthFailedException: Kee
perErrorCode = AuthFailed for /blobstore/telelog-topology-xxxx-nn-nnnnnnnnn-stormconf.ser
... View more
Labels:
- Labels:
-
Apache Storm
02-23-2017
05:28 AM
The following messages are shown in the log. Please help us regarding this . 2017-02-22 16:24:41,102 WARN ResumeXCommand:523 - SERVER[xxxx.xxxx.corpintra.net] USER[yyyyyy] GROUP[-] TOKEN[] APP[OZ_zzzzzzl] JOB[nnnnn-nnnnnnnn-oozie-xxyy-W] ACTION[] E1100: Command precondition does not hold before execution, [workflow's status is RUNNING is not SUSPENDED], Error Code: E1100
... View more
Labels:
- Labels:
-
Apache Oozie
02-15-2017
08:45 PM
Yes.I was able to remove the interpreter by following the steps given by Daniel.
... View more
02-15-2017
08:42 PM
The issue was resolved once the steps.
... View more
02-10-2017
07:07 AM
Hi, Please help me in disabling spark interpreter in Zeppelin.
... View more
Labels:
- Labels:
-
Apache Zeppelin
02-04-2017
05:36 PM
1 Kudo
Getting the following error while starting the supervisor. Please help to rectify the issue. o.a.s.d.supervisor [ERROR] Error on initialization of server mk-supervisor
java.lang.RuntimeException: java.lang.ClassNotFoundException: backtype.storm.generated.LSSupervisorId
at org.apache.storm.utils.LocalState.deserialize(LocalState.java:83)
at org.apache.storm.utils.LocalState.get(LocalState.java:130)
at org.apache.storm.local_state$ls_supervisor_id.invoke(local_state.clj:61)
at org.apache.storm.daemon.supervisor$standalone_supervisor$reify__7622.prepare(supervisor.clj:1212)
at org.apache.storm.daemon.supervisor$fn__7479$exec_fn__3183__auto____7480.invoke(supervisor.clj:765)
at clojure.lang.AFn.applyToHelper(AFn.java:160)
at clojure.lang.AFn.applyTo(AFn.java:144)
at clojure.core$apply.invoke(core.clj:630)
at org.apache.storm.daemon.supervisor$fn__7479$mk_supervisor__7524.doInvoke(supervisor.clj:763)
at clojure.lang.RestFn.invoke(RestFn.java:436)
at org.apache.storm.daemon.supervisor$_launch.invoke(supervisor.clj:1200)
at org.apache.storm.daemon.supervisor$_main.invoke(supervisor.clj:1233)
at clojure.lang.AFn.applyToHelper(AFn.java:152)
at clojure.lang.AFn.applyTo(AFn.java:144)
at org.apache.storm.daemon.supervisor.main(Unknown Source)
Caused by: java.lang.ClassNotFoundException: backtype.storm.generated.LSSupervisorId
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.storm.utils.LocalState.deserialize(LocalState.java:78)
... 14 more
2017-02-03 13:36:23.847 o.a.s.util [ERROR] Halting process: ("Error on initialization")
java.lang.RuntimeException: ("Error on initialization")
at org.apache.storm.util$exit_process_BANG_.doInvoke(util.clj:341)
at clojure.lang.RestFn.invoke(RestFn.java:423)
at org.apache.storm.daemon.supervisor$fn__7479$mk_supervisor__7524.doInvoke(supervisor.clj:763)
at clojure.lang.RestFn.invoke(RestFn.java:436)
at org.apache.storm.daemon.supervisor$_launch.invoke(supervisor.clj:1200)
at org.apache.storm.daemon.supervisor$_main.invoke(supervisor.clj:1233)
at clojure.lang.AFn.applyToHelper(AFn.java:152)
at clojure.lang.AFn.applyTo(AFn.java:144)
at org.apache.storm.daemon.supervisor.main(Unknown Source)
... View more
Labels:
- Labels:
-
Apache Storm
02-03-2017
08:33 PM
Getting the following message: ERROR nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(229)) - Unexpected error starting NodeStatusUpdater
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN signal from Resourcemanager, Registration of NodeManager failed, Message from ResourceManager: Disallowed NodeManager from hostxxx.corpintra.net, Sending SHUTDOWN signal to the NodeManager.
... View more
Labels: