Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Error during service installation

Solved Go to solution

Re: Error during service installation

Contributor

retrying.. after deleting everything in /dfs by:

 

cd /dfs

rm -r -f *

 

on each host including the CDh manager server...

 

This actually worked!!! thanks Darren, Thanks DIO.. here are the steps when you need to reinstall from a botched delete of hive or zookeeper and the service add gives you a null pointer exception, (see my prior posts).

 

1)  Stop the cluster

2) delete the cluster

3) cd /dfs on each host

4) rm -r -f *

5) using the manager add the cluster

6) select the hosts tab and select alll hosts

7) choose all the defaults and click continue to start firstrun()

 

results:

 

Command Progress

Completed 20 of 20 steps.

 

Waiting for ZooKeeper Service to initialize

Finished waiting

Details

 

Starting ZooKeeper Service

Completed 1/1 steps successfully

Details

 

Checking if the name directories of the NameNode are empty. Formatting HDFS only if empty.

Sucessfully formatted NameNode.

Details

 

Starting HDFS Service

Successfully started HDFS service

Details

 

Creating HDFS /tmp directory

HDFS directory /tmp already exists.

Details

 

Creating MR2 job history directory

Successfully created MR2 job history directory.

Details

 

Creating NodeManager remote application log directory

Successfully created NodeManager remote application log directory.

Details

 

Starting YARN (MR2 Included) Service

Successfully started service

Details

 

Creating Hive Metastore Database

Created Hive Metastore Database.

Details

 

Creating Hive Metastore Database Tables

Created Hive Metastore Database Tables successfully.

Details

 

Creating Hive user directory

Successfully created Hive user directory.

Details

 

Creating Hive warehouse directory

Successfully created Hive warehouse directory.

Details

 

Starting Hive Service

Service started successfully.

Details

 

Creating Oozie database

Oozie database created successfully.

Details

 

Installing Oozie ShareLib in HDFS

Successfully installed Oozie ShareLib

Details

 

Starting Oozie Service

Service started successfully.

Details

 

Creating Sqoop user directory

Successfully created Sqoop user directory.

Details

 

Starting Sqoop Service

Service started successfully.

Details

 

Starting Hue Service

Service started successfully.

Details

 

 

Re: Error during service installation

Contributor

Happiness:

Cloudera.jpg

Re: Error during service installation

Glad you got it working!

Re: Error during service installation

Contributor

Thanks Dio, the only minor issue on hiveserver2 was that it kept trying to restart because of the following error:

 

org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp":hdfs:supergroup:drwxr-xr-x

 

Which clearly is a permission issue quickly solved with a chmod of the hadoop file system

 

[root@hadoopmngr tmp]# sudo -u hive hadoop fs -ls /tmp
Found 2 items
drwxr-xr-x   - hdfs   supergroup          0 2014-04-01 15:50 /tmp/.cloudera_health_monitoring_canary_files
drwxrwxrwt   - mapred hadoop              0 2014-03-31 22:20 /tmp/logs

 

[root@hadoopmngr tmp]# sudo -u hdfs hadoop fs -chmod -R 777 /
[root@hadoopmngr tmp]# sudo -u hive hadoop fs -ls /tmp
Found 2 items
drwxrwxrwx   - hdfs   supergroup          0 2014-04-01 15:55 /tmp/.cloudera_health_monitoring_canary_files
drwxrwxrwt   - mapred hadoop              0 2014-03-31 22:20 /tmp/logs

 

And t hen the hive server2 started just fine.

 

Thanks again for your help.

 

Carl

Re: Error during service installation

Setting your entire HDFS to 777 perms is not recommended. You just needed to make sure there was a 777 /tmp directory. CM normally creates this for you as part of HDFS setup, and there's a command in HDFS to create the /tmp dir if you need to run it manually.

 

It's not really convenient to undo this, so if you're fine with having effectively no hdfs permissions, then you can keep things as is. Otherwise you can manually re-restrict permissions to each folder appropriately. Anybody else hitting this issue should just create /tmp instead of the recursive chmod.

Re: Error during service installation

Contributor

You are correct.  I only noticed this after the command.  Should have restricted to the /tmp. 

 

I'm not concerned as this is a research environment with no restricted data.

 

Thanks dlo,

 

Carl

Highlighted

Re: Error during service installation

New Contributor

The solution worked for me, and my issue was due to not completing the Cloudera Manager install in the one window. I thought that I could restart from where I left off, but had nothing but issues.

I had tried to install Hive again and also Hue, but still had issues, so i suspect that there may have been issues prior to these, and there were dependencies.

 

The solution appears to be a good way to clean out and rebuild a cluster, for probably multiple type issues, and it does not really take that long to complete. 

Re: Error during service installation

Contributor


Express Cluster Installation - Add Hosts

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


     

 

 

 

 

 

 

 

 

 

 

 


 

 

Express Cluster Installation - Add Services

 

Choose the CDH 5 services that you want to install on your cluster.

 

Choose a combination of services to install.
 Core Hadoop

HDFS, YARN (Includes MapReduce 2), ZooKeeper, Oozie, Hive, Hue, and Sqoop
 Core with Real-Time Delivery

HDFS, YARN (Includes MapReduce 2), ZooKeeper, Oozie, Hive, Hue, Sqoop, and HBase


 Core with Real-Time Query

HDFS, YARN (Includes MapReduce 2), ZooKeeper, Oozie, Hive, Hue, Sqoop, and Impala


 Core with Real-Time Search

HDFS, YARN (Includes MapReduce 2), ZooKeeper, Oozie, Hive, Hue, Sqoop, and Solr


 Core with Spark

HDFS, YARN (Includes MapReduce 2), ZooKeeper, Oozie, Hive, Hue, Sqoop, and Spark


 All Services

HDFS, YARN (Includes MapReduce 2), ZooKeeper, Oozie, Hive, Hue, Sqoop, HBase, Impala, Solr, Spark, and Keystore Indexer


 Custom Services

Choose your own services. Services required by chosen services will automatically be included. Note that Flume can be added after your initial cluster has been set up.


 

 

 

 

 

 

 

 


 

 

 Back

 1 2 3

Re: Error during service installation

Contributor

 


 

 

Database Setup
 

On this page you configure and test database connections. If using custom databases, create the databases first according to the Installing and Configuring an External Database section of the Installation Guide.

 


Use Custom DatabasesUse Embedded Database

When using the Embedded Database, passwords are auto generated. Please copy them down.

 

Hive
 
 
 
 

Database Host Name:   Database Type: Database Name :   Username:   Password:
hadoopmngr:7432   MySQLPostgreSQLOracle   hive1   hive1   dAPyUZE0mt 

Re: Error during service installation

Contributor

 Skipped. Will create database in later step

Don't have an account?
Coming from Hortonworks? Activate your account here