Member since
12-10-2015
12
Posts
2
Kudos Received
0
Solutions
08-10-2018
06:11 AM
@sunile.manjee apologies for typo its meta files.
... View more
08-10-2018
04:16 AM
I have a zip file with 10k Mera files and 10k data files. What is the best way to ingest this in hive?
Meta and data tables are separate
... View more
- Tags:
- Data Processing
- Hive
Labels:
- Labels:
-
Apache Hive
06-04-2018
11:53 AM
Wont be able to copy out of production.. But it gives error as "Could not decompress data. Input is invalid."
... View more
06-04-2018
11:28 AM
Hi, We have database created and data is present in HDFS location as well, but while running any query (count) hive is showing 0. Data is Text file format and snappy compressed.
... View more
Labels:
- Labels:
-
Apache Hive
10-05-2017
09:39 AM
I need to distcp hdfs://nn1:port/foo/bar/2016/* and hdfs://nn1:port/foo/bar/2017/* into hdfs://nn2:port/foo/bar/2016/* and
hdfs://nn2:port/foo/bar/2017/* in one go..How can we achieve that? If I use distcp hdfs://nn1:port/foo/bar/2016/ \ hdfs://nn1:port/foo/bar/2017 hdfs://nn2:port/foo/bar/ then underlying directoris i.e. 2016 and 2017 are not getting created. I need distcp to create these directories and copy data.
... View more
- Tags:
- Distcp
Labels:
- Labels:
-
Apache Hadoop
09-08-2017
09:03 AM
Hi @Jay SenSharma, Thanks very much for the information. "String connString="jdbc:oracle:thin:@prodHost:1521:ORCL" this worked fine.
... View more
09-08-2017
03:34 AM
Geerally when we use --connect option in sqoop we use "jdbc:oracle:thin:@hostname:port/DB_SERVICE_NAME". But can we user DB_SID instead of DB_SERVICE_NAME in connect option? If yes what will be the syntax for that.
... View more
Labels:
- Labels:
-
Apache Sqoop
12-17-2016
01:01 PM
How to use oracle database tns string in Sqoop connect parameter?
... View more
Labels:
- Labels:
-
Apache Sqoop
02-04-2016
10:04 AM
@Gangadhar Kadam , thanks for the suggestion, but we circumvent the problem in an unethical way. We took table backup and then renamed partitions in Hive warehouse and then ran msck repair table command. It created new partitions in Hive which were renamed and then we created directories with old partition names and dropped them with drop partition command deleting metastore entry.
... View more
12-30-2015
02:15 PM
1 Kudo
We have a table with partitions as p_date/p_workflow/p_attempt, we have data in p_date as "2016-10-15" which we need to change to "2015-10-15". Query we used is "alter table "table_name" partition (p_date='2016-10-15' ,p_workflow_id='0000450-151026183415051-oozie-oozi-W', p_attempt=0) rename to partition (p_date='2015-10-25' ,p_workflow_id='0000450-151026183415051-oozie-oozi-W', p_attempt=0);" which is yielding error "FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Unable to rename partition." Hive version is Hive 0.13.0.2.1.3.0-563
... View more
- Tags:
- Data Processing
- Hive
Labels:
- Labels:
-
Apache Hive