Member since
02-08-2019
28
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 4333 | 06-13-2019 12:19 AM |
09-23-2019
04:26 AM
@tmater the following command , did not remove the partitions/dirs in my cloudera version. ALTER TABLE tblName DROP IF EXISTS PARTITION ( part_col='201801*' ) PURGE. I think special characters such as * cannot be used in this version.
... View more
09-17-2019
12:11 AM
@tmater unfortunately this kind of expression ( part_col='201801*' ) does not work.
... View more
09-05-2019
03:54 AM
@tmater my Cloudera version is 5.9 . I forgot to mentioned that.
... View more
08-20-2019
01:37 AM
I would like to drop multiple partitions of an impala table at once. Can I use the following statement in order to delete all the partitions of January ? ALTER TABLE schema.Table DROP IF EXISTS PARTITION (part_col='201801*') PURGE ; Can I use Star Wildcard just as unix?
... View more
Labels:
- Labels:
-
Apache Impala
08-14-2019
12:00 PM
Let's assume that I have a table test_tbl which was created through impala-shell. I have a few questions : REFRESH the table only when I add new data through HIVE or HDFS commands ? That is when I am doing insert into ...through impala-shell no need for refreshing ? INVALIDATE METADATA of the table only when I change the structure of the table (add columns, drop partitions) through HIVE? DROPping partitions of a table through impala-shell (i.e alter table .. drop partition .. purge). Do I have to do REFRESH or INVALIDATE METADATA? DROPping partitions of a table through impala-shell . How can I compute the new stats of the partitioned table? Compute incremental stats OR Drop Incremental stats before dropping partition ? Thanks in advance.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala
06-13-2019
12:19 AM
@Consult I found the solution. The sqoop command creates a YARN process, type MAPREDUCE. So if we only kill the processes through unix shell, this YARN process will continue to run at the background. So from the cloudera manager, we go to YARN --> Applications and then we kill the YARN process. .
... View more
06-07-2019
06:45 AM
@Consult i thought the same think, but I had an incident yesterday. I killed the process but the morning I saw the table to be imported under the sqoop schema. I was wondering if there is another way to kill the command.
... View more
06-07-2019
02:11 AM
I run a sqoop import command sqoop import --connect jdbc:oracle:thin:.... --username .... --password ... --query "SELECT $CHOOSE_COLUMN_NAMES FROM $OTABLE where $OWHERE and \$CONDITIONS" ... through unix shell. If the command takes a long time how can i kill through shell ? Thanks in advance.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Sqoop