Member since
01-25-2018
10
Posts
2
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3997 | 02-15-2018 12:24 PM | |
8955 | 02-15-2018 12:55 AM |
10-31-2018
02:45 PM
@Li Jiayan Can you try below change and try to install. Edit "/usr/lib/python2.6/site-packages/resource_management/libraries/script/http://script.py" python script and comment line "package_version = None" (line# 541).
... View more
04-17-2018
05:58 PM
@Anurag Mishra Can you post DESCRIBE FORMATTED test_ext from destination cluster. And also try to DROP and recreate external table command. CREATE EXTERNAL TABLE IF NOT EXISTS test_ext (ID int, DEPT int, NAME string ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE LOCATION '/old_hive';
... View more
03-14-2018
03:57 PM
@Neeraj Sabharwal Very nice complete article. It worked as described. However i ran into a small issue, hive is throwing "Permission denied" error for gcs data. Here is full trace. I was able to do "ls" on gcs successfully. Only difference i see from your trace is owner for gcs shows as "hdfs" for you and "root" for me. Any suggestions please? I tried making file in bucket as public link as well. hive> !hdfs dfs -ls gs://bmasna-csv-test/ ;
18/03/14 15:50:39 INFO gcs.GoogleHadoopFileSystemBase: GHFS version: 1.7.0-hadoop2
18/03/14 15:50:40 WARN gcs.GoogleHadoopFileSystemBase: No working directory configured, using default: 'gs://bmasna-csv-test/'
Found 1 items
drwx------ - root root 0 2018-03-13 17:23 gs://bmasna-csv-test/data1
hive> CREATE EXTERNAL TABLE IF NOT EXISTS EMP(
> EmployeeID INT,FirstName STRING, Title STRING,
> State STRING)
> COMMENT 'Employee'
> ROW FORMAT DELIMITED
> FIELDS TERMINATED BY ','
> STORED AS TEXTFILE
> LOCATION 'gs://bmasna-csv-test/data1/';
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:java.security.AccessControlException: Permission denied: user=root, path="gs://bmasna-csv-test/data1":atxhive:atxhive:drwx------)
... View more
03-01-2018
06:03 AM
@Sagar Shimpi @Jay Kumar SenSharma RHEL/CentOS 7 - MySql community server with RPM installation runs into multiple issues. Here are full instructions on how you could install manually using Mysql RPM Bundle(https://dev.mysql.com/downloads/) when you do not have internet and using local Repository. If you try to use "yum install mysql-community-{client,common,libs}-* mysql-5.*", you will run into errors. So install each rpm in the order below. If your issue is resolved Accept the answer for the benefit of others. Else post any issue encountered as well. Unfortunately, MySQL website does not have full instructions :). Thanks! [root@ mysql]# rpm -ivh mysql-community-common-5.7.21-1.el7.x86_64.rpm
warning: mysql-community-common-5.7.21-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing... ################################# [100%]
Updating / installing...
1:mysql-community-common-5.7.21-1.e################################# [100%]
[root@ mysql]# rpm -ivh mysql-community-libs-5.7.21-1.el7.x86_64.rpm
warning: mysql-community-libs-5.7.21-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing... ################################# [100%]
Updating / installing...
1:mysql-community-libs-5.7.21-1.el7################################# [100%]
[root@cpsh20-03 mysql]# rpm -ivh mysql-community-client-5.7.21-1.el7.x86_64.rpm
warning: mysql-community-client-5.7.21-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing... ################################# [100%]
Updating / installing...
1:mysql-community-client-5.7.21-1.e################################# [100%]
[root@ mysql]# rpm -ivh mysql-community-server-5.7.21-1.el7.x86_64.rpm
warning: mysql-community-server-5.7.21-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
error: Failed dependencies:
libaio.so.1()(64bit) is needed by mysql-community-server-5.7.21-1.el7.x86_64
libaio.so.1(LIBAIO_0.1)(64bit) is needed by mysql-community-server-5.7.21-1.el7.x86_64
libaio.so.1(LIBAIO_0.4)(64bit) is needed by mysql-community-server-5.7.21-1.el7.x86_64
[root@ mysql]# wget http://mirror.centos.org/centos/6/os/x86_64/Packages/libaio-0.3.107-10.el6.x86_64.rpm
--2018-03-01 05:34:21-- http://mirror.centos.org/centos/6/os/x86_64/Packages/libaio-0.3.107-10.el6.x86_64.rpm
Resolving mirror.centos.org (mirror.centos.org)... 66.29.48.168, 2607:f2d8:1:e::10
Connecting to mirror.centos.org (mirror.centos.org)|66.29.48.168|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 21708 (21K) [application/x-rpm]
Saving to: ‘libaio-0.3.107-10.el6.x86_64.rpm’
100%[==================================================================================================================>] 21,708 --.-K/s in 0.07s
2018-03-01 05:34:21 (303 KB/s) - ‘libaio-0.3.107-10.el6.x86_64.rpm’ saved [21708/21708]
[root@ mysql]# rpm -ivh libaio-0.3.107-10.el6.x86_64.rpm
warning: libaio-0.3.107-10.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID c105b9de: NOKEY
Preparing... ################################# [100%]
Updating / installing...
1:libaio-0.3.107-10.el6 ################################# [100%]
[root@ mysql]# rpm -Uvh mysql-community-server-5.7.21-1.el7.x86_64.rpm
warning: mysql-community-server-5.7.21-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing... ################################# [100%]
Updating / installing...
1:mysql-community-server-5.7.21-1.e################################# [100%]
[root@ mysql]# systemctl start mysqld.service
[root@ mysql]# mysql -u root -p
Enter password:
... View more
02-15-2018
12:24 PM
1 Kudo
@Girish Khole Here are the steps you can do. I had same issue and solved. Solution: [root ~]# yum list installed | grep storm storm_2_6_4_0_91-slider-client.x86_64 1.1.0.2.6.4.0-91 installed You can see storm-slider says "installed". But it did not pickup from HDP repo i provided. On the node run below [root ~]# yum-complete-transaction --notice it saying.. There are 1 outstanding transactions to complete. [root ~]# yum remove storm_2_6_4_0_91-slider-client (check your version to just make sure) Now, goto Ambari and install or Re-install on the node. And Ambari Component Version alert also should go away after re-install.
... View more
02-15-2018
12:55 AM
1 Kudo
Try running below on the node you're installing hive2. 1)yum list installed |grep hive -- make sure repo is listed as @HDP-2.6-repo-1. If it says "installed" then do below steps. 2)yum-complete-transaction -- this is important to run. 3)yum remove hive2_ .... -- all components which are having "installed" but without proper repo. 4)Goto Ambari and install again. This is a issue is happening for almost to any component due to break/killed yum and quasi installed status.
... View more
02-15-2018
12:33 AM
For Error "Cannot match packagefor regexp name oozie_${stack_version}.Available packages:['accumulo','accumulo-conf-standalone','accumulo-source','accumulo_2_6_3_0_235-conf-" Run below in the node where Oozie is being installed. yum list installed | grep oozie -- check if the output has proper HDP repo @HDP-2.6-repo-1 listed. If it just says "installed" then run below yum-complete-transaction -- this should complete outstanding transactions. Then remove oozie from the node. yum remove oozie -- check if there is any version listed due to repo issues prior to removing. Then goto Ambari and try Re-install. It worked for me. Also should clear Ambari Component version alert.
... View more