Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1918 | 06-15-2020 05:23 AM | |
| 15460 | 01-30-2020 08:04 PM | |
| 2071 | 07-07-2019 09:06 PM | |
| 8107 | 01-27-2018 10:17 PM | |
| 4569 | 12-31-2017 10:12 PM |
11-10-2017
12:27 PM
on the second approach if we removed the folder /xxxx/sdc/hadoop/hdfs/data on the problematic worker and then we restart the HDFS component on the worker then it will create the folder - data again ?
... View more
11-10-2017
12:25 PM
hi Aditya , not clear for me if we change the fs.datanode.failed.volumes.tolerated to then it will affected all workers machine and we have problem only on worker01 , so do you mean that we need to change it to 1 and restart the HDFS service and then return it to 0?
... View more
11-10-2017
10:54 AM
when we start the data node on one of the workers machine we get: ERROR datanode.DataNode (DataNode.java:secureMain(2691)) - Exception in secureMain
org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 4, volumes configured: 5, volumes failed: 1, volume failures tolerated: 0 and this WARN checker.StorageLocationChecker (StorageLocationChecker.java:check(208)) - Exception checking StorageLocation [DISK]file:/grid/sdc/hadoop/hdfs/data/
org.apache.hadoop.util.DiskChecker$DiskErrorException: Directory is not writable: /xxxx/sdc/hadoop/hdfs/data what are the steps that needs to fix it?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
11-06-2017
09:51 AM
in ambari GUI we want to add the graphite service so we select actions --> add service --> check the box of graphite --> assign masters --> assign slaves and masters but when click next to the next screen "assign slaves and masters" this screen stay only 2 second and then we get the customize services ( so we cant check the boxes in the screen of assign slaves and masters because its disappeared after 2 seconds , why this happened ?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
11-05-2017
10:24 AM
yes the IP's and hostname are now ok , but still cant start the ambari-agent do you think need to restart the proccess that hold the port - 10000 ?
... View more
11-05-2017
09:22 AM
when we run the netstat -tnlpa | grep 10000 , we get tcp 0 0 45.89.12.111:10000 45.89.12.110:44570 ESTABLISHED 15598/java
tcp 0 0 45.89.12.111:10000 45.89.12.110:55109 ESTABLISHED 15598/java regarding the iptables it is stooped , and we get the output - connection refused from nc command , and the full machine name is - machine-master03.pop.com
... View more
11-05-2017
08:21 AM
from some unclear reason when we start the ambari agent on master machine its failed from the log we can see that: ERROR 2017-10-02 11:58:42,597 script_alert.py:123 - [Alert][hive_server_process] Failed with result CRITICAL: ['Connection failed on host machine-master01.pop.com:10000 (Traceback (most recent call last):\n File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py", line 211, in execute\n
ldap_password=ldap_password)\n File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/hive_check.py", line 79, in check_thrift_port_sasl\n timeout=check_command_timeout)\n File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__\n self.env.run()\n File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160,
in run\n what cause this problem?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
11-01-2017
10:40 AM
we get many error like EmulatedXAResource@64deb58f, error code TMNOFLAGS and transaction: [DataNucleus Transaction, ID=Xid=#, enlisted resources=[]]
2017-11-01 10:35:20,363 DEBUG [main]: DataNucleus.Transaction (Log4JLogger.java:debug(58)) - Running enlist operation on resource: org.datanucleus.store.rdbms.ConnectionFactoryImpl$EmulatedXAResource@64deb58f, error code TMNOFLAGS and transaction: [DataNucleus Transaction, ID=Xid=#, enlisted resources=[]]
javax.jdo.JDODataStoreException: Error executing SQL query "select "DB_ID" from "DBS"".
java.sql.SQLSyntaxErrorException: Table/View 'DBS' does not exist.
Caused by: ERROR 42X05: Table/View 'DBS' does not exist. java.lang.RuntimeException: Error applying authorization policy on hive configuration: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
... View more
11-01-2017
09:49 AM
I run the command but it stuck for along time , regarding the hive-server.pid we have only the file - ls /var/run/hive/
hive.pid , bytheway hive server is running on master03 machine , but not on master01
... View more
11-01-2017
09:06 AM
we try to start the hive server on master01 machine as the following: [root@master01 hive]# su hive [hive@master01 hive]$ /usr/bin/hive --service hiveserver2 but hive command not print anything and hive server still stop what are the option to check why hive not start?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Hive