can i get your number so that i can clear the concept of partitioning Help appreciated Mukesh ... View more

Thanks mukesh But can I knw what if In my textfile (20 columns ) that is comma separated in which i want to partition by a columns 3rd and 4th and I just want to directly create a managed partition table now because the file size is too long that i cannot bring down my third, fourth column to the last .In such situation what is the best alternative ... View more

HI Mukesh , thanks for the reply but my question here is I am explaining in steps The first step for me is to create a managed partiton table like CREATE TABLE `myTable`( `ossc_rc` string, `subnetwork1` string) PARTITIONED BY ( `part` string) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' LINES TERMINATED BY '\n' STORED AS INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'; now my step is to load the partition table right! my text input file is mytable.txt ossc_rc part subnetwork 1 cds 34r 4 fe 964 5 cds 35r 4 cds 36r please remember that my 2nd column in the file is part which you have taken for partition now i have to load data into the managed partition table and the statement will be LOAD DATA LOCAL INPATH '/HOME/HIMANSHU/MYTABLE.TXT' PARTITION (par ='cds'); now here i m getting confused while loading data into the table how it will know that which column in my file contains cds and which column actually it is do we need to keep my partition column in the last column? ... View more

Thanks Carroll ... View more