Member since
09-24-2015
527
Posts
136
Kudos Received
19
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2267 | 06-30-2017 03:15 PM | |
3286 | 10-14-2016 10:08 AM | |
8557 | 09-07-2016 06:04 AM | |
10334 | 08-26-2016 11:27 AM | |
1530 | 08-23-2016 02:09 PM |
02-03-2016
04:47 PM
1 Kudo
Hi: Why after restart the namenode i can see this retries?? 2016-02-03 17:43:17,121 - Must wait to leave safemode since High Availability is not enabled.
2016-02-03 17:43:17,121 - Checking the NameNode safemode status since may need to transition from ON to OFF.
2016-02-03 17:43:17,122 - Execute['hdfs dfsadmin -fs hdfs://lnxbig05.cajarural.gcr:8020 -safemode get | grep 'Safe mode is OFF''] {'logoutput': True, 'tries': 180, 'user': 'hdfs', 'try_sleep': 10}
2016-02-03 17:43:20,088 - Retrying after 10 seconds. Reason: Execution of 'hdfs dfsadmin -fs hdfs://lnxbig05.cajarural.gcr:8020 -safemode get | grep 'Safe mode is OFF'' returned 1.
2016-02-03 17:43:32,396 - Retrying after 10 seconds. Reason: Execution of 'hdfs dfsadmin -fs hdfs://lnxbig05.cajarural.gcr:8020 -safemode get | grep 'Safe mode is OFF'' returned 1.
2016-02-03 17:43:44,761 - Retrying after 10 seconds. Reason: Execution of 'hdfs dfsadmin -fs hdfs://lnxbig05.cajarural.gcr:8020 -safemode get | grep 'Safe mode is OFF'' returned 1.
2016-02-03 17:43:57,370 - Retrying after 10 seconds. Reason: Execution of 'hdfs dfsadmin -fs hdfs://lnxbig05.cajarural.gcr:8020 -safemode get | grep 'Safe mode is OFF'' returned 1.
2016-02-03 17:44:09,734 - Retrying after 10 seconds. Reason: Execution of 'hdfs dfsadmin -fs hdfs://lnxbig05.cajarural.gcr:8020 -safemode get | grep 'Safe mode is OFF'' returned 1.
2016-02-03 17:44:22,049 - Retrying after 10 seconds. Reason: Execution of 'hdfs dfsadmin -fs hdfs://lnxbig05.cajarural.gcr:8020 -safemode get | grep 'Safe mode is OFF'' returned 1.
2016-02-03 17:44:34,350 - Retrying after 10 seconds. Reason: Execution of 'hdfs dfsadmin -fs hdfs://lnxbig05.cajarural.gcr:8020 -safemode get | grep 'Safe mode is OFF'' returned 1.
2016-02-03 17:44:46,675 - Retrying after 10 seconds. Reason: Execution of 'hdfs dfsadmin -fs hdfs://lnxbig05.cajarural.gcr:8020 -safemode get | grep 'Safe mode is OFF'' returned 1.
2016-02-03 17:44:59,021 - Retrying after 10 seconds. Reason: Execution of 'hdfs dfsadmin -fs hdfs://lnxbig05.cajarural.gcr:8020 -safemode get | grep 'Safe mode is OFF'' returned 1.
Safe mode is OFF
2016-02-03 17:45:11,442 - HdfsResource['/tmp'] {'security_enabled': False, 'only_if': None, 'keytab': [EMPTY], 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'default_fs': 'hdfs://lnxbig05.cajarural.gcr:8020', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': None, 'user': 'hdfs', 'owner': 'hdfs', 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf', 'type': 'directory', 'action': ['create_on_execute'], 'mode': 0777}
2016-02-03 17:45:11,445 - checked_call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://lnxbig05.cajarural.gcr:50070/webhdfs/v1/tmp?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpP7WEHk 2>/tmp/tmphm0eeD''] {'logoutput': None, 'quiet': False}
2016-02-03 17:45:13,273 - checked_call returned (0, '')
2016-02-03 17:45:13,274 - HdfsResource['/user/ambari-qa'] {'security_enabled': False, 'only_if': None, 'keytab': [EMPTY], 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'default_fs': 'hdfs://lnxbig05.cajarural.gcr:8020', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': None, 'user': 'hdfs', 'owner': 'ambari-qa', 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf', 'type': 'directory', 'action': ['create_on_execute'], 'mode': 0770}
2016-02-03 17:45:13,276 - checked_call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://lnxbig05.cajarural.gcr:50070/webhdfs/v1/user/ambari-qa?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpF1IxAv 2>/tmp/tmpkMhn6U''] {'logoutput': None, 'quiet': False}
2016-02-03 17:45:13,391 - checked_call returned (0, '')
2016-02-03 17:45:13,392 - HdfsResource[None] {'security_enabled': False, 'only_if': None, 'keytab': [EMPTY], 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'default_fs': 'hdfs://lnxbig05.cajarural.gcr:8020', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': None, 'user': 'hdfs', 'action': ['execute'], 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf'}
... View more
Labels:
- Labels:
-
Apache Hadoop
02-03-2016
10:17 AM
1 Kudo
Hi: Today I have resolved this with those code from R Sys.setenv("HADOOP_CMD"="/usr/hdp/2.3.2.0-2950/hadoop/bin/yarn")
Sys.setenv("HADOOP_STREAMING"="/usr/hdp/2.3.2.0-2950/hadoop-mapreduce/hadoop-streaming-2.7.1.2.3.2.0-2950.jar")
Sys.setenv("HADOOP_HOME"="/usr/hdp/2.3.2.0-2950/hadoop")
Sys.setenv("HADOOP_PREFIX"="/usr/hdp/2.3.2.0-2950/hadoop")
... View more
02-03-2016
09:46 AM
1 Kudo
Hi: i have resolved the problem adding the jar file into the hadoop path in the Namenode server /usr/hdp/2.3.2.0-2950/hadoop/lib/hadoop-client-2.7.1.jar Regards.
... View more
02-03-2016
08:24 AM
Hi: After do this same error, here my xml file, 0: jdbc:hive2://lnxbig05.cajarural.gcr:10000> GRANT SELECT ON TABLE logs TO USER bigotes WITH GRANT OPTION;
Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Permission denied: Principal [name=hive, type=USER] does not have following privileges for operation GRANT_PRIVILEGE [[SELECT with grant] on Object [type=TABLE_OR_VIEW, name=default.logs]] (state=08S01,code=1) [hive@lnxbig05 conf.server]$ pwd
/etc/hive/conf/conf.server
[hive@lnxbig05 conf.server]$ cat hiveserver2-site.xml
<configuration>
<property>
<name>hive.conf.restricted.list</name>
<value>hive.security.authorization.enabled,hive.security.authorization.manager,hive.security.authenticator.manager</value>
</property>
<property>
<name>hive.metastore.uris</name>
<value>thrift://lnxbig05.cajarural.gcr:9083</value>
</property>
<property>
<name>hive.security.authenticator.manager</name>
<value>org.apache.hadoop.hive.ql.security.SessionStateUserAuthenticator</value>
</property>
<property>
<name>hive.security.authorization.enabled</name>
<value>true</value>
</property>
<property>
<name>hive.security.authorization.manager</name>
<value>org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory</value>
</property>
... View more
02-03-2016
07:33 AM
2 Kudos
Hi: -is a good way to have in the same server 1 namenode and datanode in production?? Thanks.
... View more
Labels:
- Labels:
-
Apache Hadoop
02-03-2016
07:21 AM
HI: Ok ill, do it, where i can put the steps or de documentations?? Thanks
... View more
02-02-2016
05:24 PM
Hi: After type this, i cant connect to hive metastore, why the connection is closed?? 5: jdbc:hive2://lnxbig05.cajarural.gcr:10000 (closed)> !connect jdbc:hive2://lnxbig05.cajarural.gcr:10000 **** **** org.apache.hive.jdbc.HiveDriver;
Connecting to jdbc:hive2://lnxbig05.cajarural.gcr:10000
org/apache/hive/jdbc/HiveDriver;
6: jdbc:hive2://lnxbig05.cajarural.gcr:10000 (closed)>
... View more
Labels:
- Labels:
-
Apache Hive
02-02-2016
04:44 PM
Hi: I have resolved this from Ambari Hive config interfaz!! I have added this to the script hive-env.sh HIVE_AUX_JARS_PATH=/usr/hdp/lib/elasticsearch-hadoop-2.2.0-rc1.jar And i restarted hive services. ***I always use hive to run the queries, is better beeline???? Many thanks
... View more
02-02-2016
04:35 PM
Hi: I have the same problem, but still doesnt work: I have [bigotes@lnxbig05 auxlib]$ pwd
/usr/hdp/2.3.2.0-2950/hive-server2/auxlib elasticsearch-hadoop-2.2.0-rc1.jar and when i run this query i get this error REATE EXTERNAL TABLE rsi(name STRING)
STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
TBLPROPERTIES('es.resource'='radio/artists'); Error occurred executing hive query: Error while compiling statement: FAILED: SemanticException Cannot find class 'org.elasticsearch.hadoop.hive.EsStorageHandler' I don know why Hive doesnt find this class on the jar. Thanks
... View more