Member since
09-17-2016
29
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3727 | 10-09-2019 06:15 PM |
10-09-2019
06:15 PM
I have solved the issue. My Namenode was in safe mode. So i have turned off safe mode by using :- hadoop dfsadmin -safemode leave
... View more
10-09-2019
05:32 PM
Yes i didn't notice that it has space. So i used trim for it.
... View more
10-09-2019
05:16 PM
I am using cloudera VB. I am trying to login to beeline. I tried the username and passwod (empty) but it's not working :- !connect jdbc:hive2://localhost:10000/ Connecting to jdbc:hive2://localhost:10000/ Enter username for jdbc:hive2://localhost:10000/: Enter password for jdbc:hive2://localhost:10000/: Error: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/: java.net.ConnectException: Connection refused (state=08S01,code=0) 0: jdbc:hive2://localhost:10000/ (closed)> @ [cloudera@quickstart ~]$ beeline 2019-10-09 17:06:46,217 WARN [main] mapreduce.TableMapReduceUtil: The hbase-prefix-tree module jar containing PrefixTreeCodec is not present. Continuing without it. Beeline version 1.1.0-cdh5.7.0 by Apache Hive beeline> !connect jdbc:hive2://localhost:10000/ scan complete in 5ms Connecting to jdbc:hive2://localhost:10000/ Enter username for jdbc:hive2://localhost:10000/: hadoop Enter password for jdbc:hive2://localhost:10000/: Error: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/: java.net.ConnectException: Connection refused (state=08S01,code=0) 0: jdbc:hive2://localhost:10000/ (closed)> Can someone know the username and password to login to beeline. I have checked hive metastore and hive server2. it's working :- [cloudera@quickstart ~]$ sudo service hive-metastore status Hive Metastore is running [cloudera@quickstart ~]$ sudo service hive-server2 status Hive Server2 is running [ OK ]
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
10-06-2019
12:26 AM
I am using cloudera virtual box. while creating partitions, it is creating all the partitions whether they are unique or not create table product_order1(id int,user_id int,amount int,product string, city string, txn_date string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'; LOAD DATA LOCAL INPATH 'txn' INTO TABLE product_order1;
Loading data to table oct19.product_order1
Table oct19.product_order1 stats: [numFiles=1, totalSize=303] OK Time taken: 0.426 seconds hive>
> set hive.exec.dynamic.partition = true;
hive>
> set hive.exec.dynamic.partition.mode = true;
hive>
> create table dyn_part(id int,user_id int,amount int,product string,city string) PARTITIONED BY(txn_date string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'; OK Time taken: 0.14 seconds hive > INSERT OVERWRITE TABLE dyn_part PARTITION(txn_date) select id,user_id,amount,product,city,txn_date from product_order1; Result which i have received :- Loading data to table oct19.dyn_part partition (txn_date=null)
Time taken for load dynamic partitions : 944
Loading partition {txn_date=04-02-2015}
Loading partition {txn_date= 03-04-2015}
Loading partition {txn_date=01-02-2015}
Loading partition {txn_date=03-04-2015}
Loading partition {txn_date= 01-01-2015}
Loading partition {txn_date=01-01-2015}
Loading partition {txn_date= 01-02-2015}
Time taken for adding to write entity : 5 Partition oct19.dyn_part{txn_date= 01-01-2015} stats: [numFiles=1, numRows=1, totalSize=25, rawDataSize=24] Partition oct19.dyn_part{txn_date= 01-02-2015} stats: [numFiles=1, numRows=1, totalSize=25, rawDataSize=24] Partition oct19.dyn_part{txn_date= 03-04-2015} stats: [numFiles=1, numRows=2, totalSize=50, rawDataSize=48] Partition oct19.dyn_part{txn_date=01-01-2015} stats: [numFiles=1, numRows=1, totalSize=26, rawDataSize=25] Partition oct19.dyn_part{txn_date=01-02-2015} stats: [numFiles=1, numRows=1, totalSize=26, rawDataSize=25] Partition oct19.dyn_part{txn_date=03-04-2015} stats: [numFiles=1, numRows=1, totalSize=26, rawDataSize=25] Partition oct19.dyn_part{txn_date=04-02-2015} stats: [numFiles=1, numRows=1, totalSize=25, rawDataSize=24] MapReduce Jobs Launched: Stage-Stage-1: Map: 1 Cumulative CPU: 4.03 sec HDFS Read: 4166 HDFS Write: 614 SUCCESS Total MapReduce CPU Time Spent: 4 seconds 30 msec
... View more
Labels:
- Labels:
-
Apache Hive