Member since
12-21-2016
83
Posts
5
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
41274 | 02-08-2017 05:56 AM | |
5729 | 01-02-2017 11:05 PM |
02-08-2017
06:04 AM
Just curious to find..... Why Sqoop will not allow us to create an external table while sqooping the data from RDBMS ?
... View more
Labels:
- Labels:
-
Apache Sqoop
02-08-2017
05:56 AM
2 Kudos
Here is work around, which i have implemented. For an external table, If you are trying to drop a partition and as-well would like to delete the data. This can be achieved as below. 1. Alter external table as internal table -- by changing the TBL properties as external =false 2. Drop the partitions -- when you drop the partitions, data pertained to the partitions will also be dropped as now this table is managed table 3. Alter back the table as external=True. By doing this, there more controlled on what we are deleting and drop the partitions rather than using hadoop rm command
... View more
02-08-2017
05:47 AM
In a flat file, i have certain keywords, which are sensitive, i would like to identify these sensitive keywords row by row. These keywords could appear in any column of the flat file. Appreciate any help. Either in Hive or Pig anything is fine.
... View more
Labels:
- Labels:
-
Apache Pig
01-27-2017
12:07 AM
While i was trying to drop a partition based on date range, i unable to achieve it and below is what i am trying to do alter table X drop partition(partdate <= (select max(partdate) as from Y)); I am getting error, while i am executing above query -- cannot recognize input near '(' 'select' 'max' in constant Looks like the alter statement accepts only the constant value rather then a sub-query. Basicaly - Alter table drop partition ( partdate <= date -- and this date need to fetch from another table). Any help is appreciated.
... View more
Labels:
- Labels:
-
Apache Hive
01-25-2017
05:21 AM
I have an external table which is created with partitions and i would like to delete/drop few partition along with data as i no longer require it. Appreciate any suggestions.
... View more
Labels:
- Labels:
-
Apache Hive
01-24-2017
09:26 PM
I have an external table which is created with partitions and i would like to delete/drop few partition along with data as i no longer require it. Appreciate any suggestions.
... View more
Labels:
- Labels:
-
Apache Hive
01-20-2017
10:03 PM
I have hive data with ORC format, and there is a date column on which we are doing partitioned and i would like to move the data to archival directory based on partitioned column name date and if it 30 days older.
... View more
Labels:
- Labels:
-
Apache Hive
01-04-2017
07:05 PM
Thanks.. It was typo mistake where i didn't capitalize 'T' in fileType
... View more
01-03-2017
11:27 PM
I have configured flume conf file to write the data in text format, however, i couldn't see the data in text format and below is the screen shot. I see some non-printable characters intially and then i can see text data. I just want to get rid of non-printable characters.
... View more
Labels:
- Labels:
-
Apache Flume
01-02-2017
11:05 PM
Ok let me fix and test it
... View more