Member since
02-15-2017
11
Posts
1
Kudos Received
0
Solutions
09-01-2017
03:30 AM
I am having the same problem.. @mbigelow can you kindly provide some guidance as to how to initiate a hivecontext properly in an IDE like IntelliJ or Eclipse?
... View more
08-15-2017
11:47 PM
I was afraid of this... thank you for clarifying @csguna 🙂
... View more
08-01-2017
10:48 PM
i searched but could not get hold of any such properties...
... View more
07-31-2017
03:39 AM
1 Kudo
Hello, When we insert data from staging table into a production table using dynamic partition inserts, the files created at the partition directory are like: 0000_0. However, say, for a process where data is loaded on a daily basis, after the first data insertion in a partition, the file names are like 0000_0_copy_1 for the second day, 0000_0_copy_2 for the third day and so on... I want to create a filename like so: partitionName_datestamp [ex. IND_20173107] so that it helps to maintain a logical and relevant file structure for any manual intervention needs. I am aware that we can achieve this by executing a shell script after Hive jobs. But, can we control this from within Hive? Regards, Anirban. PS: I am using Cloudera 5.8. Hive table backed as parquet.
... View more
Labels:
- Labels:
-
Apache Hive
03-10-2017
03:05 AM
Thank a lot!! this removed the error from the logs. 🙂
... View more
03-06-2017
03:51 AM
Hi All, I am trying to run a Shell action on Oozie to load data to HDFS. The data gets loaded properly. However, the job fails with the follwoing stderr: log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA".
put: `/user/admin/RnR_Demo/Datasets/shellUpload.TestDir/50MB.zip': File exists
log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA".
put: `/user/admin/RnR_Demo/Datasets/shellUpload.TestDir/5MB.zip': File exists
log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA".
put: `/user/admin/RnR_Demo/Datasets/shellUpload.TestDir/CentOS-6.5-x86_64-bin-DVD1(2).zip': File exists
rm: cannot remove `oozie-hadoop-conf-1488800663720': Is a directory
rm: cannot remove `tmp': Is a directory
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1] here you can see that the hdfs -put command runs successfully since there are files with the same name in the location from a previous run. however, the error: log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA". is bugging me since the job fails in spite of data being loaded to HDFS Please help.
... View more
Labels:
- Labels:
-
Apache Oozie
-
Apache YARN
-
Cloudera Manager
-
HDFS