@lysConsulting Have you ticked Kudu checkbox under Hive configuration in Cloudera Manager UI? Refer to: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/kudu_hms.html#concept_enable_hms https://cwiki.apache.org/confluence/display/Hive/Kudu+Integration   In CDP : https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/kudu-hms-integration/topics/kudu-hms-enabling.html ... View more

@hanumanth Review the logs to get a better idea on what it is failing on. If we have that many partitions, do check what's the value of hive.msck.repair.batch.size and if it is set to 0 at present, you may set this to a value such as 3000 and retry. ... View more

Which version are you on? Is this Cloudera Hive distribution?  I think UPDATE command is not working because it is not an acid(transactional) table. For update command to work, it has to be an ACID table. @roti  ... View more

@Shawn Here is a small example on how to find out what's the percentage of NOT NULL value of column maker:   select ((tot_cnt - a.null_maker)/tot_cnt)*100 as pcnt_not_null_maker from (select count(maker) as null_maker from used_cars where maker is NULL) a Left outer join (select count(*) as tot_cnt from used_cars) b   You may try this for all individual columns. ... View more

@SwaggyPPPP Is this a partitioned table? In that case you could run the ALTER TABLE  command as follows: alter table my_table add columns(field4 string,field5 string) CASCADE; Let us know if this issue occurs consistently, after adding new columns, and your Cloudera product version? ... View more

@RamuAnnamalai It looks similar to https://issues.apache.org/jira/browse/IMPALA-10042 Please check what's the value of "Maximum Cached File Handles" under Impala Configuration in CM UI? Set that to Zero(0) and see if the issue still reappears.    How do you write to the table? Is there a chance, the data is getting corrupted during the insert?  ... View more

@Asim- Unless your final table has to be a Hive managed(acid) table then, you could incrementally update the Hive table directly using Sqoop. e.g. sqoop import --connect jdbc:oracle:thin:@xx.xx.xx.xx:1521:ORCL --table EMPLOYEE --username user1 --password welcome1 --incremental lastmodified --merge-key employee_id --check-column emp_timestamp --target-dir /usr/hive/warehouse/external/empdata/ Otherwise, the way you are trying is the actually the way Cloudera recommends it. ... View more