Member since
05-15-2018
34
Posts
0
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1008 | 05-15-2019 02:54 PM | |
2635 | 06-22-2018 03:27 PM |
06-22-2018
03:27 PM
https://community.hortonworks.com/articles/15104/small-files-in-hadoop.html
... View more
06-21-2018
08:50 PM
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
06-21-2018
02:20 PM
Sorry @ssharma it is working but when I trying like this
hive -e 'set hive.cli.print.header=true; create table test row format delimited fields terminated by '|' as select * from test1'>/home/yourfile.csv in this scenario it only showing the header not the whole data csv file
... View more
06-20-2018
05:58 PM
For this command I getting only the header.I want both header and data in the csv file
... View more
06-16-2018
08:01 PM
Labels:
- Labels:
-
Apache Hive
06-02-2018
04:04 PM
1)CREATE TABLE md
ROW FORMAT SERDE
'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
WITH SERDEPROPERTIES () 'avro.schema.url'='/user/cloudera/departments.avsc')
STORED as INPUTFORMAT
'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'; 2)LOAD DATA INPATH '/user/cloudera/departments/part-m-00000.avro' into table md; hive> SET hive.exec.dynamic.partition = true; hive> SET hive.exec.dynamic.partition.mode = nonstrict; 3)create table mda(a int) partitioned by(name string); 4)nsert overwrite table mda partition(name) select department_id,department_name from md; Try this way you can create paritions from avro file too
... View more
05-30-2018
10:26 PM
I told you to create the hive table with serde Syntax: create table <dbname>.<tablename)(a string,b string,c string,d string,e string,f string,g string,h string,i string,j string)
ROW FORMAT SERDE 'parquet.hive.serde.ParquetHiveSerDe'
STORED AS
INPUTFORMAT "parquet.hive.DeprecatedParquetInputFormat"
OUTPUTFORMAT "parquet.hive.DeprecatedParquetOutputFormat";
... View more
05-30-2018
06:35 PM
Get the schema by using parquet-tool schema filename in hdfs and use that schema to build external table in hive and use parquet serde at time of creation of hive table.
... View more
05-30-2018
06:07 PM
Did the source file is also in parquet file format?
... View more
05-30-2018
05:28 PM
Please share the Create statement from hive table.
... View more
- « Previous
-
- 1
- 2
- Next »