About eMazarakis

eMazarakis · ‎09-23-2019

@tmater the following command , did not remove the partitions/dirs in my cloudera version. ALTER TABLE tblName DROP IF EXISTS PARTITION ( part_col='201801*' ) PURGE. I think special characters such as * cannot be used in this version.

eMazarakis · ‎09-17-2019

@tmater unfortunately this kind of expression ( part_col='201801*' ) does not work.

eMazarakis · ‎09-05-2019

@tmater my Cloudera version is 5.9 . I forgot to mentioned that.

eMazarakis · ‎08-28-2019

@hores As you can see the doc there is nothing about computing stats for specific table-columns. Stats are for the whole table. How can you know which info for statistics impalad daemons might want to use during the join queries ?

eMazarakis · ‎08-26-2019

How can I run stats only on some of the partitions and some/none of the columns? @hores in order to take stats for a certain partition as you mentioned above you have to run the following command COMPUTE INCREMENTAL STATS [db_name.]table_name [PARTITION (partition_spec)] partition_spec ::= partition_col=constant_value For further info you can read the documentation : impala_compute_stats.html

eMazarakis · ‎08-20-2019

I would like to drop multiple partitions of an impala table at once. Can I use the following statement in order to delete all the partitions of January ? ALTER TABLE schema.Table DROP IF EXISTS PARTITION (part_col='201801*') PURGE ; Can I use Star Wildcard just as unix?

eMazarakis · ‎08-14-2019

Let's assume that I have a table test_tbl which was created through impala-shell. I have a few questions : REFRESH the table only when I add new data through HIVE or HDFS commands ? That is when I am doing insert into ...through impala-shell no need for refreshing ? INVALIDATE METADATA of the table only when I change the structure of the table (add columns, drop partitions) through HIVE? DROPping partitions of a table through impala-shell (i.e alter table .. drop partition .. purge). Do I have to do REFRESH or INVALIDATE METADATA? DROPping partitions of a table through impala-shell . How can I compute the new stats of the partitioned table? Compute incremental stats OR Drop Incremental stats before dropping partition ? Thanks in advance.

eMazarakis · ‎08-09-2019

@EricL My findings are the following: The table is managed. Also the HiveServer2 Enable Impersonation is setting to TRUE. I do not understand what this option is doing. Can you explain me ? HiveMetastoreServer log I can't see anything about permissions.

eMazarakis · ‎08-07-2019

@Tomas79 here is the ACL of the hdfs path of the dir/table. # file: /user/hive/warehouse/sqoop.db/sr_tt # owner: hive # group: hive # flags: --t user::rwx group::rwx other::rwx Now if I go from Hive editor (HUE) and execute the query DROP TABLE sr_tt PURGE; the files were not deleted. Also Do you know where can I found the logs of the NameNode and hive server's log?

eMazarakis · ‎08-06-2019

@BildervicI’m afraid it is not clear what I am saying. I have a table which is owned to impala user. When I am dropping the table through impala editor (Hue) with the above command the table & hdfs files were deleted. But when I have a table which is owned to hive user and I am trying to delete it through hive editor (HUE) with the above command the table is disappeared from the gui but the files were not deleted. And I am asking why is this happened ?

Online	Offline
Last Visited	‎04-17-2020 12:14 AM

Member Since	‎02-08-2019 01:15 AM
Last Visited	‎04-17-2020 12:14 AM
Posts	28
Kudos received	2

Cloudera Community

Re: How to kill a sqoop import .. command through ...

Re: How can I Alter multiple partitions at once on...

Re: How can I Alter multiple partitions at once on...

Re: How can I Alter multiple partitions at once on...

Re: Impala compute incremental stats on specific c...

Re: Impala compute incremental stats on specific c...

How can I Alter multiple partitions at once on Imp...

When I have to Refresh / Invalidate Metadata a tab...

Re: How to properly delete a hive table through HU...

Re: How to properly delete a hive table through HU...

Re: How to properly delete a hive table through HU...