Cloudera Community
Bogolese
user rank
Contributor
My Accepted Solutions
Show All

Re: Is hdfs symbolic link available?

by Contributor in Support Questions
‎06-13-2016 11:32 AM
1 Kudo
‎06-13-2016 11:32 AM
1 Kudo
Any update on this?  It SURE would be nice to have symlinks in HDFS!!!! ... View more

Re: Running MR on CDH 5 cluster tries to connect t...

by Contributor in Support Questions
‎06-19-2014 02:15 PM
‎06-19-2014 02:15 PM
Okay, I found the problem.  It was in the alternatives system (why did I not look there before?!?!?!?).   Apparently when I installed YARN it added a path to hadoop-conf of /etc/hadoop/conf.cloudera.yarn and made it a HIGHER PRIORITY than the /etc/hadoop/conf.cloudera.mapreduce that I need.  Simply removing the path worked:   alternatives --remove hadoop-conf /etc/hadoop/conf.cloudera.yarn ... View more

Re: Running MR on CDH 5 cluster tries to connect t...

by Contributor in Support Questions
‎06-19-2014 12:38 PM
‎06-19-2014 12:38 PM
Thank you for the tip, but no joy.  😞   In fact, simply running "mapred queue -list" from the command line attempts to connect to the YARN resource manager!   I even went so far as to delete and recreate the cluster.  I cannot get rid of YARN, no way, no how . . . ... View more

Running MR on CDH 5 cluster tries to connect to YA...

by Contributor in Support Questions
‎06-19-2014 07:23 AM
‎06-19-2014 07:23 AM
I originally installed YARN, then MAPREDUCE on my CM5/CDH5 cluster on CentOS 6.  I then removed YARN the best way I know how, but removing all nodes from YARN, then deleting YARN from my cluster.   Now, when I run a MR job it is still trying to connect to the YARN resource manager:   cloudera mapreduce INFO client.RMProxy: Connecting to ResourceManager at masternode.dns.name/999.999.999.999:8032   I removed and re-added MAPREDUCE, deploying the client configuration at each step.  Clearly there are vestigal remains of YARN.  How can I "un-ring" the YARN bell? ... View more

Re: CM 5 Installation on CentOS 6

by Contributor in Support Questions
‎06-12-2014 06:48 AM
‎06-12-2014 06:48 AM
Apparently this was the issue as it reported a successful install. But now CM doesn't come up in my browser at port 7180.  😞   Still working through that.  The content of the log file follows:     Loaded plugins: fastestmirror, refresh-packagekit, security Loading mirror speeds from cached hostfile  * base: centos.mia.host-engine.com  * extras: mirror.raystedman.net  * updates: mirror.5ninesolutions.com Setting up Install Process Resolving Dependencies --> Running transaction check ---> Package cloudera-manager-server.x86_64 0:5.0.2-1.cm502.p0.297.el6 will be installed --> Processing Dependency: cloudera-manager-daemons = 5.0.2 for package: cloudera-manager-server-5.0.2-1.cm502.p0.297.el6.x86_64 --> Running transaction check ---> Package cloudera-manager-daemons.x86_64 0:5.0.2-1.cm502.p0.297.el6 will be installed --> Finished Dependency Resolution Dependencies Resolved ================================================================================  Package                 Arch   Version                  Repository        Size ================================================================================ Installing:  cloudera-manager-server x86_64 5.0.2-1.cm502.p0.297.el6 cloudera-manager 8.0 k Installing for dependencies:  cloudera-manager-daemons                          x86_64 5.0.2-1.cm502.p0.297.el6 cloudera-manager 315 M Transaction Summary ================================================================================ Install       2 Package(s) Total download size: 315 M Installed size: 428 M Downloading Packages: -------------------------------------------------------------------------------- Total                                           317 kB/s | 315 MB     16:56      Running rpm_check_debug Running Transaction Test Transaction Test Succeeded Running Transaction Warning: RPMDB altered outside of yum.    Installing : cloudera-manager-daemons-5.0.2-1.cm502.p0.297.el6.x86_64     1/2    Installing : cloudera-manager-server-5.0.2-1.cm502.p0.297.el6.x86_64      2/2    Verifying  : cloudera-manager-daemons-5.0.2-1.cm502.p0.297.el6.x86_64     1/2    Verifying  : cloudera-manager-server-5.0.2-1.cm502.p0.297.el6.x86_64      2/2 Installed:   cloudera-manager-server.x86_64 0:5.0.2-1.cm502.p0.297.el6                      Dependency Installed:   cloudera-manager-daemons.x86_64 0:5.0.2-1.cm502.p0.297.el6                     Complete! ... View more

Re: CM 5 Installation on CentOS 6

by Contributor in Support Questions
‎06-12-2014 06:46 AM
‎06-12-2014 06:46 AM
<sarcasm>Yeah, and I checked that the power switch was on and I unplugged the machine and waited thirty seconds before plugging it back in.</sarcasm> ... View more

Re: CM 5 Installation on CentOS 6

by Contributor in Support Questions
‎06-11-2014 01:19 PM
‎06-11-2014 01:19 PM
CM 4.6 was installed, but I UNinstalled it before I started this process.   1.  rpm -qa | grep cloudera returns nothing   2.  yum clean all was run (several times actually) -- I run it before every install attempt   3.  The installation was initiated by downloading cloudera-manager-installer.bin from cloudera.com (the Express version), making it executable, and running it (sudo ./cloudera-manager-installer.bin).  If there is something I need to do to get the repo to /etc/yum.repos.d, please let me know, but I figured the installer would do that.   Note that the original installation complaint was the the j2sdk1.7 package wasn't available, so I downloaded that from cloudera.com and rpm -ivh 'd it.   Thank you for your help. ... View more

CM 5 Installation on CentOS 6

by Contributor in Support Questions
‎06-11-2014 12:56 PM
‎06-11-2014 12:56 PM
Well, as pleasant as CM 4.x installations were, that's as miserable as the CM 5 installation is for me.  😞   It started with squacks about j2sdk1.7, which I had to manually download and rpm up.  Now I get the following in /var/log/cloudera-manager-installer/3.install-cloudera-manager-server.log, which seems to say that it's trying to install CM 4.6?  I am thoroughly confused and (more importantly) dead in the water . . .   Loaded plugins: fastestmirror, refresh-packagekit, security Loading mirror speeds from cached hostfile  * base: mirror.5ninesolutions.com  * extras: mirror.atlanticmetro.net  * updates: centos.chi.host-engine.com Setting up Install Process Resolving Dependencies --> Running transaction check ---> Package cloudera-manager-server.x86_64 0:4.6.0-1.cm460.p0.140 will be installed --> Processing Dependency: cloudera-manager-daemons = 4.6.0 for package: cloudera-manager-server-4.6.0-1.cm460.p0.140.x86_64 --> Running transaction check ---> Package cloudera-manager-daemons.x86_64 0:4.6.0-1.cm460.p0.140 will be installed --> Finished Dependency Resolution Dependencies Resolved ================================================================================  Package                  Arch   Version                 Repository        Size ================================================================================ Installing:  cloudera-manager-server  x86_64 4.6.0-1.cm460.p0.140    cloudera-manager 7.6 k Installing for dependencies:  cloudera-manager-daemons x86_64 4.6.0-1.cm460.p0.140    cloudera-manager 135 M Transaction Summary ================================================================================ Install       2 Package(s) Total download size: 135 M Installed size: 175 M Downloading Packages: http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-daemons-4.6.0-1.cm460.p0.140.x86_64.rpm: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404 Not Found" Trying other mirror. http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-server-4.6.0-1.cm460.p0.140.x86_64.rpm: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404 Not Found" Trying other mirror. Error Downloading Packages:   cloudera-manager-server-4.6.0-1.cm460.p0.140.x86_64: failure: RPMS/x86_64/cloudera-manager-server-4.6.0-1.cm460.p0.140.x86_64.rpm from cloudera-manager: [Errno 256] No more mirrors to try.   cloudera-manager-daemons-4.6.0-1.cm460.p0.140.x86_64: failure: RPMS/x86_64/cloudera-manager-daemons-4.6.0-1.cm460.p0.140.x86_64.rpm from cloudera-manager: [Errno 256] No more mirrors to try. ... View more
Labels:

Re: NoClassDefFoundError thrown when using TypedBy...

by Contributor in Support Questions
‎02-14-2014 07:37 AM
‎02-14-2014 07:37 AM
Thank you.  Shame on me for not "finishing the job" as it were. ... View more

Re: NoClassDefFoundError thrown when using TypedBy...

by Contributor in Support Questions
‎02-13-2014 10:33 AM
‎02-13-2014 10:33 AM
Harsh,   I used the "bogus" workaround to get this going by including hadoop-streaming-2.0.0-cdh4.5.0.jar in the /lib directory of my job jar.  Bogus, obviously, because it is version dependent and the jar is already distributed out to the cluster.  I would prefer not to use the distributed cache for the same reason.   So, I am (finally) returning to your suggestion and have tried it without success.  I still get the NoClassDefFoundError on org.apache.hadoop.typedbytes.TypedBytesWritable.   Also, doesn't HADOOP_CLASSPATH only apply to the node on which the job is launched?  Or is my understanding flawed?   I would *prefer* to make whatever changes are necessary to the MR configuration via CM to make the streaming jar available to all MR jobs.  To that end I modified "MapReduce Client Environment Safety Valve for hadoop-env.sh" with values for HADOOP_CLASSPATH and HADOOP_TASKTRACKER_OPTS without success.  I am open to your sage advice -- preferrably setting the classpath in a "please use current version" way. ... View more
Contact Me
Online
Offline
Last Visited
‎06-17-2016 12:27 PM
Community Statistics
Member Since ‎01-30-2014 03:52 PM
Last Visited ‎06-17-2016 12:27 PM
Posts 18
Kudos received 1