Member since
07-28-2016
9
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1303 | 07-28-2016 09:28 AM |
07-29-2016
11:56 AM
can i get your number so that i can clear the concept of partitioning Help appreciated Mukesh
... View more
07-29-2016
09:36 AM
Thanks mukesh But can I knw what if In my textfile (20 columns ) that is comma separated in which i want to partition by a columns 3rd and 4th and I just want to directly create a managed partition table now because the file size is too long that i cannot bring down my third, fourth column to the last .In such situation what is the best alternative
... View more
07-29-2016
08:18 AM
HI Mukesh , thanks for the reply but my question here is I am explaining in steps The first step for me is to create a managed partiton table like CREATE TABLE `myTable`( `ossc_rc` string, `subnetwork1` string) PARTITIONED BY ( `part` string) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' LINES TERMINATED BY '\n' STORED AS INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'; now my step is to load the partition table right! my text input file is mytable.txt
ossc_rc part subnetwork 1 cds 34r 4 fe 964 5 cds 35r 4 cds 36r please remember that my 2nd column in the file is part which you have taken for partition now i have to load data into the managed partition table and the statement will be LOAD DATA LOCAL INPATH '/HOME/HIMANSHU/MYTABLE.TXT' PARTITION (par ='cds'); now here i m getting confused while loading data into the table how it will know that which column in my file contains cds and which column actually it is do we need to keep my partition column in the last column?
... View more
07-29-2016
07:51 AM
1 Kudo
I am literally confuse that do we need to create a normal table before creting a partition table , help is appreciated
... View more
Labels:
- Labels:
-
Apache Hive
07-28-2016
12:30 PM
Thanks Carroll
... View more
07-28-2016
09:28 AM
I Agree with your answer @Carroll but it arised one more question then before big data came into picture how facebook or any other media was doing the processing of big data and unstructured data with the RDBMS?
... View more
07-28-2016
07:51 AM
sorry for theSilly question but I am new to HIve and BIG data world :can any one explain with neat example what is considered as structured and what is considered as unstructured if we compare to the RDBMS
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)