Member since
07-31-2013
1924
Posts
462
Kudos Received
311
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1969 | 07-09-2019 12:53 AM | |
| 11873 | 06-23-2019 08:37 PM | |
| 9139 | 06-18-2019 11:28 PM | |
| 10124 | 05-23-2019 08:46 PM | |
| 4575 | 05-20-2019 01:14 AM |
11-30-2014
06:35 AM
General ephemeral port ranges can be controlled from the OS side, but I've hardly ever seen a need to be doing such a thing. What is your exact issue or situation that is leading you down this path?
... View more
11-30-2014
06:03 AM
One possibility of issue is that your services are incorrectly listening on the wrong interface. What is the output of "netstat -anp | grep 50060" specifically from your 'master' and 'slave' hosts?
... View more
11-30-2014
05:07 AM
The simplest way to express this, beginning with a raw text file, would be to do the two steps below: 1. First, use MR to form a word count. Split each line into words and count them as 1 each in Mapper, and aggregate they counts by word as key in Reducer. 2. Second, use yet another subsequent MR job to read and invert the key to sort it in the opposite form, wherein the key is now the count and the value are the words that match the count. Run either with a TotalOrderPartitioner or a single reducer to get your final result.
... View more
11-30-2014
04:58 AM
1 Kudo
Glad to know it worked, thank you for following up. Make sure to mark the topic resolved, so others have a better time searching and finding this if they hit the same/similar issues.
... View more
11-30-2014
04:49 AM
Its more than likely that Oozie is still running with MR1 config-set even though it has YARN libraries in it properly. What MapReduce Service is associated as a dependency under CM -> Oozie -> Configuration? Make sure it is set to YARN, and restart your Oozie service. Does that help?
... View more
11-30-2014
04:40 AM
In addition to Roy's link, we do have a guide in our documentation that targets both Developers and Operators/Administrators in terms of what needs to be changed/mapped between MR1 and MR2. You can find these at http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cdh_ig_mapreduce_to_yarn_migrate.html
... View more
11-30-2014
03:50 AM
Which streaming jar are you using specifically? Are you using the Oozie streaming action? Can you share your actual job-launching command (or the relevant Oozie workflow and associated scripts/files)?
... View more
11-24-2014
09:48 PM
1 Kudo
> Is it that i need more memory on the node manager? Yes, you can do with more memory on the node manager configs (key: yarn.nodemanager.resource.memory-mb). Try setting it to 2 or 3 GB across all 3 NodeManagers, restart them, and retry your job example.
... View more
08-27-2014
11:50 PM
The link at http://archive.cloudera.com/cdh5/cdh/5/hbase-0.98.1-cdh5.1.0.releasenotes.html shows all patches backported into CDH 5.1.0 atop Apache HBase 0.98.1 release.
... View more
08-10-2014
10:44 PM
Your DNs do not have adequate space to store files. Can you please post your output of "sudo -u hdfs hdfs dfsadmin -report"?
... View more