Member since
12-13-2017
22
Posts
1
Kudos Received
0
Solutions
01-15-2019
04:54 PM
1 Kudo
@Andrew Watson Hi Andrew did you find a way out for this issue
... View more
05-22-2018
02:58 AM
Have an issue creating a table using the below DDL, please help! DDL: DROP TABLE IF EXISTS cm3rm1_test; CREATE EXTERNAL TABLE cm3rm1_test PARTITIONED BY (process_date string) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' STORED as INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat' LOCATION 'hdfs://xyz/cm3rm1' TBLPROPERTIES ('avro.schema.url'='hdfs:///abc/AutoGeneratedSchema.avsc'); trying to create the table using the above is resulting in an error. but works fine without partitioning. @smanjee @Jasper took this https://community.hortonworks.com/questions/22135/is-there-a-way-to-create-hive-table-based-on-avro.html as a reference doesn't seem working for me. any suggestions, how to get this working? Thanks Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. org.apache.hadoop.hive.ql.metadata.HiveException: Partition column name process_date conflicts with table columns. (state=08S01,code=1)
... View more
Labels:
- Labels:
-
Apache Hive
05-10-2018
03:29 PM
I have 3 files at different locations for which I am using 3 list file processors and then the fetch file processor. Now I want to route these files to their respective destinations which is different for all 3 files. need some help on how to do this. Thanks
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache NiFi
03-25-2018
11:41 PM
select cast(10000 as int),
case data_type
when 'TIMESTAMP' then
concat(' ,cast((cast(sys_extract_utc(update_time) AS DATE) - TO_DATE('01-01-1970 00:00:00', 'DD-MM-YYYY HH24:MI:SS')) * 86400 AS INT) last_date_time_ts')
else
concat(' ,#unknown data_type : ', data_type)
end
from (select row_number() over() ln, table_name, column_name, data_type, column_id
from test.all_tab_columns
where date_key in (select max(date_key) from test.all_tab_columns)
and table_name = 'test_table'
) data
Tried to extract the the last updated time using below query. hive is throwing exception
Error: Error while compiling statement: FAILED: ParseException line 4:7 cannot recognize input near ''cast((cast(sys_extract_utc(update_time) AS DATE) - TO_DATE('' '01' '-' in expression specification (state=42000,code=40000)
... View more
Labels:
- Labels:
-
Apache Hive
01-08-2018
07:12 PM
Labels:
- Labels:
-
Apache NiFi
12-20-2017
06:40 PM
@Aditya Sirna update in the sense the data will be appended to the existing rows or the whole thing will be overwritten?
... View more
12-20-2017
05:58 PM
Labels:
- Labels:
-
Apache HBase
12-14-2017
04:41 PM
Thanks @Matt Burgess
... View more
12-13-2017
02:55 PM
Labels:
- Labels:
-
Apache NiFi