Member since
10-01-2015
3933
Posts
1150
Kudos Received
374
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2739 | 05-03-2017 05:13 PM | |
2311 | 05-02-2017 08:38 AM | |
2457 | 05-02-2017 08:13 AM | |
2492 | 04-10-2017 10:51 PM | |
1124 | 03-28-2017 02:27 AM |
05-02-2017
08:43 AM
Your script location is wrong, start grunt in the directory with the script or provide full path to the script in the exec command
... View more
05-02-2017
08:38 AM
1 Kudo
you can create principal and keytabs manually, follow this guide, sorry it's from Pivotal but steps should be interchangeable http://pivotalhd-210.docs.pivotal.io/doc/2100/webhelp/topics/ConfiguringSecureFlume.html Which version of Ambari are you using, this seems to be an old issue https://issues.apache.org/jira/browse/AMBARI-13324
... View more
05-02-2017
08:13 AM
You can use flatten operator to remove bag thus removing the extra characters http://pig.apache.org/docs/r0.16.0/basic.html#flatten so before you finish generating the file with Pig, call the flatten operator and then load it in aHive table grunt> cat empty.bag
{} 1
grunt> A = LOAD 'empty.bag' AS (b : bag{}, i : int);
grunt> B = FOREACH A GENERATE flatten(b), i;
grunt> DUMP B;
grunt>
... View more
04-10-2017
10:51 PM
2 Kudos
remove Atlas hook class in your hive-site.xml unless you are running Atlas you don't need it. <property>
<name>hive.exec.post.hooks</name>
<value>org.apache.atlas.hive.hook.HiveHook</value>
</property>
... View more
03-28-2017
02:27 AM
1 Kudo
Answer here https://community.hortonworks.com/questions/66805/issue-when-deploying-a-new-parser-topology-in-stor.html#answer-66998
... View more
03-26-2017
02:41 AM
Does it mean with HDP 2.5+ we support date type in Avro 1.8+? Because that would be awesome Venkat.
... View more
03-17-2017
08:14 PM
@Carol Elliott actually see if you can use the -D or -conf options -conf <configuration file> specify an application configuration file
-D <property=value> use value for given property The -conf , -D , -fs and -jt arguments control the configuration and Hadoop server settings. For example, the -D mapred.job.name=<job_name> can be used to set the name of the MR job that Sqoop launches, if not specified, the name defaults to the jar name for the job - which is derived from the used table name. so in same fashion, try sqoop import -D hive.exec.scratchdir=... https://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_using_generic_and_specific_arguments
... View more
03-17-2017
08:09 PM
@Carol Elliott I didn't try this but can you try the following export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/location_of_your_hive_site.xml/*
edit your hive-site.xml file to have own scratchdir so you will have your own copy of hive-site.xml then if it works you can add it to your bash_profile and source it. source ~/.bash_profile
... View more
03-17-2017
11:58 AM
Did you try to enable them In mapred-site and tez-site? It is interesting that it cannot find it. Also try setting it in mapred-site and include it with your workflow, not necessarily enabling it on the whole cluster.
... View more