Member since
01-02-2020
5
Posts
0
Kudos Received
0
Solutions
12-02-2020
03:07 AM
Hey, @GangWar thanks for your input. As I tried to install the agent manually it says it's already installed. Following the below link: https://docs.cloudera.com/documentation/enterprise/latest/topics/install_cloudera_packages.html It has the following command which I ran: sudo yum install cloudera-manager-agent cloudera-manager-daemons The above gave me: Loaded plugins: fastestmirror Setting up Install Process Loading mirror speeds from cached hostfile Package cloudera-manager-agent-6.3.0-2117683.el6.x86_64 already installed and latest version Package cloudera-manager-daemons-6.3.0-2117683.el6.x86_64 already installed and latest version Nothing to do Then I tried to add the host using Cloudera manager, it didn't work No, manual installation did not work either.
... View more
11-26-2020
03:52 AM
I have a cluster with Cloudera manager version of 6.3.0 and 2 hosts already. Both the hosts have CentOS - 7 I am trying to add a new host server with CentOS - 6.9. While trying to add I have successfully passed through the below steps except one: 1) Specify Hosts- added one host 2) Select Repository- the public repository is chosen. 3) Accept JDK License- checkbox unchecked as I have already installed it and set JAVA_HOME 4) Enter Login Credentials- have root access/password 5) Install Agents- NOW during this phase in getting error as: Installation failed. Failed to install cloudera-manager-agent package. When I checked my logs from cloudera manager in : /var/log/cloudera-scm-server/ I saw this one warning and two error printed as follows: WARN NodeConfiguratorThread-22-0:com.cloudera.server.cmf.node.NodeConfigurator: Command bash -c 'bash /tmp/scm_prepare_node.kB9YnFSV/scm_prepare_node.sh --server_version 6.3.0 --server_build 1281944 --packages /tmp/scm_prepare_node.kB9YnFSV/packages.scm --always /tmp/scm_prepare_node.kB9YnFSV/always_install.scm --x86_64 /tmp/scm_prepare_node.kB9YnFSV/x86_64_packages.scm --certtar /tmp/scm_prepare_node.kB9YnFSV/cert.tar --unlimitedJCE false --javaInstallStrategy NONE --agentUserMode ROOT --cm https://archive.cloudera.com/cm6/6.3.0 --skipCloudConfig false | tee /tmp/scm_prepare_node.kB9YnFSV/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on inmuzv-spe-dea15187.zycus.net finished with exit status 1 ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 9067 Failed to complete installation on host server1.abc.net. ERROR CommandPusher:com.cloudera.cmf.model.DbCommand: Command 9067(GlobalHostInstall) has completed. finalstate:FINISHED, success:false, msg:Failed to complete installation. Can somebody please explain to me the above issue and how to solve them so that I can add the host? Also, I have https://archive.cloudera.com/cm6 whitelisted. Thank you in advance!
... View more
Labels:
- Labels:
-
Cloudera Manager
01-02-2020
11:09 PM
WORKED FOR ME PREFECTLY! Thanks for identifying it so soon! @EricL 🙂
... View more
01-02-2020
02:53 AM
I was testing if mapreduce is working properly on my cloudera 6.3, CDH 6.3.2 cluster. I have installed cloudera using one-click-installer Proof-of-concept one! while i excecuted the below command as it is in this link https://docs.cloudera.com/documentation/other/tutorial/CDH5/topics/ht_usage.html Command: sudo -u hdfs hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 10 100 i Got below error: WARNING: Use "yarn jar" to launch YARN applications. Number of Maps = 10 Samples per Map = 100 Wrote input for Map #0 Wrote input for Map #1 Wrote input for Map #2 Wrote input for Map #3 Wrote input for Map #4 Wrote input for Map #5 Wrote input for Map #6 Wrote input for Map #7 Wrote input for Map #8 Wrote input for Map #9 Starting Job 20/01/02 15:18:01 INFO client.RMProxy: Connecting to ResourceManager at ABC.xyz.net/192.168.xx.xx:8032 java.io.FileNotFoundException: File does not exist: hdfs://ABC.xyz.net:8020/user/yarn/mapreduce/mr-framework/3.0.0-cdh6.3.2-mr-framework.tar.gz at org.apache.hadoop.fs.Hdfs.getFileStatus(Hdfs.java:145) at org.apache.hadoop.fs.AbstractFileSystem.resolvePath(AbstractFileSystem.java:488) at org.apache.hadoop.fs.FileContext$25.next(FileContext.java:2225) at org.apache.hadoop.fs.FileContext$25.next(FileContext.java:2221) at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90) at org.apache.hadoop.fs.FileContext.resolve(FileContext.java:2227) at org.apache.hadoop.fs.FileContext.resolvePath(FileContext.java:607) at org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:460) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:146) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1570) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1567) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1567) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1588) at org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:307) at org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:360) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:368) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71) at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Please help me understand the issue. Thanks for the reply. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:313) at org.apache.hadoop.util.RunJar.main(RunJar.java:227)
... View more
Labels:
- Labels:
-
Apache Hadoop