Member since
09-17-2016
29
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2724 | 10-09-2019 06:15 PM |
10-09-2019
06:15 PM
I have solved the issue. My Namenode was in safe mode. So i have turned off safe mode by using :- hadoop dfsadmin -safemode leave
... View more
10-09-2019
05:37 PM
10-09-2019
05:32 PM
Yes i didn't notice that it has space. So i used trim for it.
... View more
10-09-2019
05:16 PM
I am using cloudera VB. I am trying to login to beeline. I tried the username and passwod (empty) but it's not working :- !connect jdbc:hive2://localhost:10000/ Connecting to jdbc:hive2://localhost:10000/ Enter username for jdbc:hive2://localhost:10000/: Enter password for jdbc:hive2://localhost:10000/: Error: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/: java.net.ConnectException: Connection refused (state=08S01,code=0) 0: jdbc:hive2://localhost:10000/ (closed)> @ [cloudera@quickstart ~]$ beeline 2019-10-09 17:06:46,217 WARN [main] mapreduce.TableMapReduceUtil: The hbase-prefix-tree module jar containing PrefixTreeCodec is not present. Continuing without it. Beeline version 1.1.0-cdh5.7.0 by Apache Hive beeline> !connect jdbc:hive2://localhost:10000/ scan complete in 5ms Connecting to jdbc:hive2://localhost:10000/ Enter username for jdbc:hive2://localhost:10000/: hadoop Enter password for jdbc:hive2://localhost:10000/: Error: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/: java.net.ConnectException: Connection refused (state=08S01,code=0) 0: jdbc:hive2://localhost:10000/ (closed)> Can someone know the username and password to login to beeline. I have checked hive metastore and hive server2. it's working :- [cloudera@quickstart ~]$ sudo service hive-metastore status Hive Metastore is running [cloudera@quickstart ~]$ sudo service hive-server2 status Hive Server2 is running [ OK ]
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
10-06-2019
12:26 AM
I am using cloudera virtual box. while creating partitions, it is creating all the partitions whether they are unique or not create table product_order1(id int,user_id int,amount int,product string, city string, txn_date string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'; LOAD DATA LOCAL INPATH 'txn' INTO TABLE product_order1;
Loading data to table oct19.product_order1
Table oct19.product_order1 stats: [numFiles=1, totalSize=303] OK Time taken: 0.426 seconds hive>
> set hive.exec.dynamic.partition = true;
hive>
> set hive.exec.dynamic.partition.mode = true;
hive>
> create table dyn_part(id int,user_id int,amount int,product string,city string) PARTITIONED BY(txn_date string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'; OK Time taken: 0.14 seconds hive > INSERT OVERWRITE TABLE dyn_part PARTITION(txn_date) select id,user_id,amount,product,city,txn_date from product_order1; Result which i have received :- Loading data to table oct19.dyn_part partition (txn_date=null)
Time taken for load dynamic partitions : 944
Loading partition {txn_date=04-02-2015}
Loading partition {txn_date= 03-04-2015}
Loading partition {txn_date=01-02-2015}
Loading partition {txn_date=03-04-2015}
Loading partition {txn_date= 01-01-2015}
Loading partition {txn_date=01-01-2015}
Loading partition {txn_date= 01-02-2015}
Time taken for adding to write entity : 5 Partition oct19.dyn_part{txn_date= 01-01-2015} stats: [numFiles=1, numRows=1, totalSize=25, rawDataSize=24] Partition oct19.dyn_part{txn_date= 01-02-2015} stats: [numFiles=1, numRows=1, totalSize=25, rawDataSize=24] Partition oct19.dyn_part{txn_date= 03-04-2015} stats: [numFiles=1, numRows=2, totalSize=50, rawDataSize=48] Partition oct19.dyn_part{txn_date=01-01-2015} stats: [numFiles=1, numRows=1, totalSize=26, rawDataSize=25] Partition oct19.dyn_part{txn_date=01-02-2015} stats: [numFiles=1, numRows=1, totalSize=26, rawDataSize=25] Partition oct19.dyn_part{txn_date=03-04-2015} stats: [numFiles=1, numRows=1, totalSize=26, rawDataSize=25] Partition oct19.dyn_part{txn_date=04-02-2015} stats: [numFiles=1, numRows=1, totalSize=25, rawDataSize=24] MapReduce Jobs Launched: Stage-Stage-1: Map: 1 Cumulative CPU: 4.03 sec HDFS Read: 4166 HDFS Write: 614 SUCCESS Total MapReduce CPU Time Spent: 4 seconds 30 msec
... View more
Labels:
- Labels:
-
Apache Hive
05-29-2017
07:16 AM
I am facing some issues in HPLSQL.I am using Hive 1.2 version Can you please help me out. 1. TRIM in plsql supports trimming of a pattern from a string.. but TRIM in hplsql removes only spaces but doesnt support removing a pattern. 2. UDFs created on hive on cannot be used in a hplsql script as its antl4 parser doesnt have it in its lexicon
... View more
09-30-2016
02:32 PM
Hi The property is already true. As I know, I can pass arguments by two methods :- 1. Passing value through CLI command is = hive -hiveconf current_date=01-01-2015 -f argument.hql Here my script is - select * from glvc.product where date = '${hiveconf:current_date}'; Here my command executes fine and I got the result. 2. Passing arguments In this case , I have already set the value in my script file and I don't want to pass the value through CLI. If I write command = hive -hiveconf:current_date -f argument.hql , I didnt get the result. That's why I had taken a variable earlier. Script - set current_date = 01-01-2015; select * from glvc.product where date = '${hiveconf:current_date}'; I don't know how to use hiveconf in this case where the value is already set. Kindly solve my problem in the case of passing arguments.
... View more
09-26-2016
05:34 PM
Hi I want to pass the parameters to Hive Script:- Note:- I don't want to execute this script by using command line arguments. So I don't want to give any arguments during run time. set current_date = 01-01-2015; select * from glvc.product where date = '${hiveconf:start_date}'; when I use execute the script, I didn't get any result:- [cloudera@quickstart ~]$ hive -hiveconf start_date=current_date -f argument_script.hql 2016-09-26 17:30:18,460 WARN [main] mapreduce.TableMapReduceUtil: The hbase-prefix-tree module jar containing PrefixTreeCodec is not present. Continuing without it. Logging initialized using configuration in file:/etc/hive/conf.dist/hive-log4j.properties OK Time taken: 8.393 seconds WARN: The method class org.apache.commons.logging.impl.SLF4JLogFactory#release() was invoked. WARN: Please see http://www.slf4j.org/codes.html#release for an explanation.
... View more
Labels:
- Labels:
-
Apache HBase
-
Apache Hive
-
MapReduce
09-22-2016
02:12 PM
Thanks
... View more
09-22-2016
02:08 PM
Thanks. I want to know something. Is it necessary that I need to put the file in /tmp location. Can't it work from anyother location from HDFS. Suppose if I have a file on /hello/employee.txt . Can't I use this employee.txt file from this path to load the data.
... View more