03-31-2018 04:25 AM - edited 03-31-2018 04:26 AM
I am trying to install the Hadoop client components on a host that is not managed by Cloudera Manager. After doing some digging, some people suggested that simply installing the hadoop-client, and adding the site configuration files should do the trick.
But I can't find hadoop-client!
Here is yum repo:
[cloudera-manager] name = Cloudera Manager, Version 5.12.1 baseurl = https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5.12.1/ gpgkey = https://archive.cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera gpgcheck = 1
And the output of yum:
$ sudo yum install hadoop-client Loaded plugins: fastestmirror ... cloudera-manager | 951 B 00:00:00 ... ... cloudera-manager/primary | 4.3 kB 00:00:00 ... ... cloudera-manager 7/7 No package hadoop-client available. Error: Nothing to do
Your help is appreciated.
03-31-2018 01:37 PM
Here are some general instructions I found internally. Note: You can change the path to match the OS release and CDH version of the client you need.
curl -O https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/cloudera-cdh5.repo
$ yum clean all $ yum install hadoop-client
$ cp * /etc/hadoop/conf
$ sudo -u hdfs hadoop fs -ls
Note: You can also download the RPM file and install locally if desired.