Member since
03-17-2016
132
Posts
106
Kudos Received
13
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1357 | 03-28-2019 11:16 AM | |
1617 | 03-28-2019 09:19 AM | |
1247 | 02-02-2017 07:52 AM | |
1685 | 10-03-2016 08:08 PM | |
596 | 09-13-2016 08:00 PM |
02-22-2017
09:27 AM
Got following exception in ambari-server.log ERROR [ambari-metrics-retrieval-service-thread-4195429] MetricsRetrievalService:421 - Unable to retrieve metrics from http://hostname:8744/api/v1/topology/summary?field=topologies. Subsequent failures will be suppressed from the log for 20 minutes.
java.net.SocketTimeoutException: Read timed out
... View more
Labels:
- Labels:
-
Apache Ambari
02-22-2017
07:26 AM
1, 2.4.1.0 2. Yes we are getting this error recently. Was working fine for long time. 3,log-check.txt 4.MetricsRetrievalService:421 - Unable to retrieve metrics from http://hostname:8744/api/v1/topology/summary?field=topologies. Subsequent failures will be suppressed from the log for 20 minutes.
java.net.SocketTimeoutException: Read timed out Error getting timeline metrics : Read timed out Cannot connect to collector: SocketTimeoutException.
22 Feb 2017 02:17:17,977 ERROR [ambari-client-thread-5524796] MetricsRequestHelper:114 - Error getting timeline metrics : Read timed out
... View more
02-22-2017
06:50 AM
I have kerberized cluster . When i am running service check for yarn throws following exception resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt /etc/security/keytabs/smokeuser.headless.keytab ambari-qa-hostname@CSCDEV.COM; yarn org.apache.hadoop.yarn.applications.distributedshell.Client -shell_command ls -num_containers 1 -jar /usr/hdp/current/hadoop-yarn-client/hadoop-yarn-applications-distributedshell.jar -timeout 300000 --queue interactive' returned 2. 17/02/22
... View more
Labels:
- Labels:
-
Apache Ambari
02-07-2017
04:25 PM
@mqureshi This doesn't work with HDP-2.5.It fails during installation.
... View more
02-07-2017
01:47 PM
@mqureshi Thanks for your answer but this is for hdp 2.4 . I have hdp 2.5 installed. This does not work for hdp-2.5
... View more
02-06-2017
12:46 PM
I have Apache-Nifi installed on my cluster. I want to integrate this with ranger for authorization.
... View more
Labels:
- Labels:
-
Apache NiFi
-
Apache Ranger
02-06-2017
05:57 AM
I want to install drill on ambari. My hdp version is 2.5 . Is there a way we can install through ambari if not what are the other ways.
... View more
- Tags:
- Hadoop Core
- hdp-2.5.0
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
02-02-2017
07:52 AM
@Saurabh I can see that ambari.properties.1 file is having permission only for root user and other users can only read that. That should not effect anything.
... View more
01-04-2017
03:22 PM
I got following error message 2017-01-04T15:23:09,819 ERROR [main] exec.TaskRunner: Error in executeTask
java.lang.NoClassDefFoundError: org/apache/tez/serviceplugins/api/TaskScheduler
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.<clinit>(TezSessionState.java:102)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.createAndInitSession(TezSessionPoolManager.java:258)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getNewSessionState(TezSessionPoolManager.java:311)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:291)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:459)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:396)
at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:134)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:197)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2073)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1744)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1453)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1171)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1161)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:232)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:183)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:399)
at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:776)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:714)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:641)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Caused by: java.lang.ClassNotFoundException: org.apache.tez.serviceplugins.api.TaskScheduler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 38 more
... View more
01-04-2017
11:41 AM
hive> set hive.execution.engine=tez;
hive> select count(*) from page_view;
Query ID = hive_20170104114317_2a7bd7d5-e1a9-4984-82ba-af3fd4a89967 Total jobs = 1
Launching Job 1 out of 1
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Tez
12-26-2016
10:29 AM
1 Kudo
Below is the error while accessing ambari hive view
"Table 'ambari.DS_JOBIMPL_xxx' doesn't exist"
Do we need to create table prior accessing ambari hive view? I do not see any step for the same in link below -
https://docs.hortonworks.com/HDPDocuments/Ambari-2.1.0.0/bk_ambari_views_guide/content/_configuring_your_cluster_for_hive_view.html
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive
12-23-2016
04:44 AM
Resetting password worked
... View more
12-22-2016
06:43 PM
I enabled ranger hive plugin but policies are not working and getting sync Below is the error logs - ERROR util.PolicyRefresher (PolicyRefresher.java:loadPolicyfromPolicyAdmin(228)) - PolicyRefresher(serviceName=datametica): failed to refresh policies. Will continue to use last known version of policies (13)
java.lang.IllegalArgumentException: Illegal character in scheme name at index 0: http://dm1.example.com:6080/service/plugins/policies/download/datametica
at java.net.URI.create(URI.java:859)
at com.sun.jersey.api.client.Client.resource(Client.java:433)
at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:157)
at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:162)
at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:70)
at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:205)
at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:175)
at org.apache.ranger.plugin.util.PolicyRefresher.run(PolicyRefresher.java:154)
Caused by: java.net.URISyntaxException: Illegal character in scheme name at index 0: http://dm1.example.com:6080/service/plugins/policies/download/datametica
at java.net.URI$Parser.fail(URI.java:2829)
at java.net.URI$Parser.checkChars(URI.java:3002)
at java.net.URI$Parser.checkChar(URI.java:3012)
at java.net.URI$Parser.parse(URI.java:3028)
at java.net.URI.<init>(URI.java:595)
at java.net.URI.create(URI.java:857
... View more
Labels:
- Labels:
-
Apache Ranger
12-22-2016
06:37 PM
I enabled HDFS ranger plugin and tried restarting HDFS but i am getting below error in logs - File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/hdfs_namenode.py", line 50, in namenode
setup_ranger_hdfs(rolling_upgrade = rolling_restart)
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/setup_ranger_hdfs.py", line 51, in setup_ranger_hdfs
hdp_version_override = hdp_version)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/setup_ranger_plugin.py", line 73, in setup_ranger_plugin
policy_user)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/ranger_functions.py", line 106, in create_ranger_repository
raise Fail('{0} Repository creation failed in Ranger admin'.format(component.title()))
resource_management.core.exceptions.Fail: Hdfs Repository creation failed in Ranger admin Can you let me know how to resolve this issue?
... View more
Labels:
- Labels:
-
Apache Ranger
12-21-2016
07:15 AM
@Kuldeep Kulkarni @Sagar Shimpi
... View more
12-21-2016
07:14 AM
1 Kudo
In Ambari Ui all service action buttons are disabled. On top it shows "Add Service Wizard In Progress" Can you help how to resolve the issue? Below is the screenshot attached -
... View more
Labels:
- Labels:
-
Apache Ambari
12-21-2016
06:54 AM
Can anyone guide me link on how to create policies in Ranger using API?
... View more
Labels:
- Labels:
-
Apache Ranger
11-03-2016
04:28 PM
Can we run multiple pig versions in same cluster?
... View more
- Tags:
- Data Processing
- Pig
Labels:
- Labels:
-
Apache Pig
11-03-2016
04:26 PM
On one of the server selinux was enabled , My bad i missed that. Thanks for your reply
... View more
11-02-2016
08:11 PM
Thanks for your reply. When i checked the following and everything is fine. I am assuming this might be the exact error Exception in thread "main" java.lang.RuntimeException: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1478000219594_0017 failed 2 times due to Error launching appattempt_1478000219594_0017_000002
... View more
11-02-2016
06:13 PM
2 Kudos
[root@hdp-2 QA]# hive hive.execution.engine=mr;
WARNING: Use "yarn jar" to launch YARN applications.
Logging initialized using configuration in file:/etc/hive/2.3.6.0-3796/0/hive-log4j.properties
Exception in thread "main" java.lang.RuntimeException: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1478000219594_0017 failed 2 times due to Error launching appattempt_1478000219594_0017_000002. Got exception: java.net.NoRouteToHostException: No Route to Host from hdp-2.3master.server.org/10.200.80.245 to hdp-2.3slave1.server.org:45454 failed on socket timeout exception: java.net.NoRouteToHostException: No route to host; For more details see: http://wiki.apache.org/hadoop/NoRouteToHost
at sun.reflect.GeneratedConstructorAccessor89.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:801)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:758)
at org.apache.hadoop.ipc.Client.call(Client.java:1459)
at org.apache.hadoop.ipc.Client.call(Client.java:1392)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
at com.sun.proxy.$Proxy89.startContainers(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagementProtocolPBClientImpl.startContainers(ContainerManagementProtocolPBClientImpl.java:96)
at sun.reflect.GeneratedMethodAccessor165.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:256)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)
at com.sun.proxy.$Proxy90.startContainers(Unknown Source)
at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.launch(AMLauncher.java:118)
at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.run(AMLauncher.java:250)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.NoRouteToHostException: No route to host
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:495)
at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:649)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:744)
at org.apache.hadoop.ipc.Client$Connection.access$3000(Client.java:397)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1521)
at org.apache.hadoop.ipc.Client.call(Client.java:1431)
... View more
- Tags:
- Data Processing
- Hive
Labels:
- Labels:
-
Apache Hive
10-07-2016
08:10 PM
2 Kudos
https://community.hortonworks.com/questions/9384/unauthorized-connection-for-super-user.html
... View more
10-06-2016
06:40 AM
Try to reset ambari admin password and have a try https://community.hortonworks.com/questions/449/how-to-reset-ambari-admin-password.html
... View more
10-03-2016
08:56 PM
@Logeswaran Radhakrishnan Please accept the answer if this worked for you
... View more
10-03-2016
08:08 PM
1 Kudo
You can can use simple hadoop -put source(local file system) destination (hdfs path). Make sure you have permission to access files on both local file system and hdfs.
... View more
10-03-2016
07:59 PM
2 Kudos
wrong mapreduce.jobhistory.address property's value. try to copy mapred-site.xml from the cluster
... View more