About Mythobeast

Teradata GTS · ‎09-09-2017

How to point namenode particular txid ?

Raghavi · ‎09-08-2017

I was able to make the job run by adding hive-exec jar in HADOOP_CLASSPATH as well as adding the jar in distributed cache. Can you throw some light as to why do we need to export the jar to classpath and also add in distributed cache.

Mythobeast · ‎05-26-2015

Thank you, mfox. My problem was that the basic install set all of HDFS's groups to "superuser" instead of "hadoop". Changing it to "hadoop" allowed mapreduce to write its history logs to the correct location.

GautamG · ‎05-12-2015

The link to the source is here https://github.com/cloudera/hadoop-common/blob/cdh5.4.0-release/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsUsage.java#L120

Mythobeast · ‎05-01-2015

That was it! Thank you!

Mythobeast · ‎04-28-2015

This turned out to be a configuration setting issue. "dfs.namenode.shared.edits.dir" had a directory value in it, and needed to be cleared.

Mythobeast · ‎06-19-2014

This turned out to be an issue with speculative execution. (e.g. conf.set("mapred.map.tasks.speculative.execution", "false"); ) It was causing the job to create a new task before the previous task had cleaned up after itself. It turns out that MultipleOutputs doesn't handle speculative execution very well.

Online	Offline
Last Visited	‎07-21-2015 01:55 PM

Member Since	‎06-02-2014 12:47 PM
Last Visited	‎07-21-2015 01:55 PM
Posts	17
Kudos received	1

Cloudera Community

Re: How do I switch HDFS to using Quorum based sto...

Re: How do I delete MultipleOutput files from a ma...

Re: NN stopped and cannot recover with error "Ther...

Re: Can't get rid of NoClassDefFoundError: org/apa...

Re: Where does MR2 output stderr to?

Re: hdfs du format change

Re: distcp not distributing

Re: How do I switch HDFS to using Quorum based sto...

Re: How do I delete MultipleOutput files from a ma...