Member since
06-21-2017
3
Posts
0
Kudos Received
0
Solutions
11-09-2017
05:54 AM
I did the same thing and at first it failed because the database didn't exist. I had to recreate the database and set the password, and then the cluster install worked. Here are the exact instructions; To do this, you will need the root password (found from a file in the system as shown below) and the oozie password. Early on in the configuration, it asked you to write them down. I took a screenshot. In any event, make sure you have it so you can reset the password after. > cat /var/lib/cloudera-scm-server-db/data/generated_password.txt
<your password>
The password above was generated by /usr/share/cmf/bin/initialize_embedded_db.sh (part of the cloudera-manager-server-db package)
and is the password for the user 'cloudera-scm' for the database in the current directory.
Generated at 20171106-141157.
> psql -U cloudera-scm -p 7432 -h localhost -d postgres
Password for user cloudera-scm: <enter password from above>
psql (9.5.9)
Type "help" for help.
postgres=# \l
List of databases
Name | Owner | Encoding | Collate | Ctype | Access privileges
--------------------+--------------------+----------+------------+------------+-----------------------------------
amon | amon | UTF8 | en_US.UTF8 | en_US.UTF8 |
hive | hive | UTF8 | en_US.UTF8 | en_US.UTF8 |
nav | nav | UTF8 | en_US.UTF8 | en_US.UTF8 |
navms | navms | UTF8 | en_US.UTF8 | en_US.UTF8 |
oozie_oozie_server | oozie_oozie_server | UTF8 | en_US.UTF8 | en_US.UTF8 |
postgres | cloudera-scm | UTF8 | en_US.UTF8 | en_US.UTF8 |
rman | rman | UTF8 | en_US.UTF8 | en_US.UTF8 |
scm | scm | UTF8 | en_US.UTF8 | en_US.UTF8 |
template0 | cloudera-scm | UTF8 | en_US.UTF8 | en_US.UTF8 | =c/"cloudera-scm" +
| | | | | "cloudera-scm"=CTc/"cloudera-scm"
template1 | cloudera-scm | UTF8 | en_US.UTF8 | en_US.UTF8 | =c/"cloudera-scm" +
| | | | | "cloudera-scm"=CTc/"cloudera-scm"
(10 rows)
postgres=# DROP DATABASE oozie_oozie_server;
DROP DATABASE
postgres=# CREATE DATABASE oozie_oozie_server;
CREATE DATABASE
postgres=# ALTER DATABASE oozie_oozie_server OWNER TO oozie_oozie_server;
postgres=# \password oozie_oozie_server
Enter new password: <Enter oozie database password>
Enter it again: <Enter again>
postgres=# \q
Then click "back" in the "Cluster Setup" page, and then click "Continue". It will restart all the steps, but the first ones should complete quickly. When it got to oozie this time, instead of failing right away, it completed the process. Yay! Hope this works for anyone else. NOTE: I am not familiar with postgres . It is possible that dropping only the schema will work without the extra steps of recreating the database and knowing the password. What I did worked so I never got a chance to play around with it.
... View more
11-08-2017
09:19 AM
I am in the cluster setup phase and am seeing an error during deployment of client configuration on host-0. I have configured single user mode and I think I have done so properly. However, the console error I am seeing is Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/{{ <-- HERE HIVE_HBASE_JAR}}/ at -e line 1.
Can't open /run/cloudera-scm-agent/process/ccdeploy_spark-conf_etcsparkconf.cloudera.spark_on_yarn_-3339932774132431897/spark-conf/hive-env.sh: No such file or directory.
++ dirname /etc/spark/conf.cloudera.spark_on_yarn
+ ROOT_DIR_NAME=/etc/spark
+ '[' '!' -e /etc/spark ']'
+ for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg}'
+ '[' -e /etc/spark/conf.cloudera.spark_on_yarn/taskcontroller.cfg ']'
+ for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg}'
+ '[' -e /etc/spark/conf.cloudera.spark_on_yarn/container-executor.cfg ']'
++ basename /etc/spark/conf
+ LINK_BASENAME=conf
+ [[ -d conf ]]
+ '[' -n scripts/control.sh ']'
+ chmod u+x /run/cloudera-scm-agent/process/ccdeploy_spark-conf_etcsparkconf.cloudera.spark_on_yarn_-3339932774132431897/scripts/control.sh
+ echo 'invoking optional deploy script scripts/control.sh'
+ SRC_PATH=/run/cloudera-scm-agent/process/ccdeploy_spark-conf_etcsparkconf.cloudera.spark_on_yarn_-3339932774132431897/spark-conf
+ '[' '!' -d /run/cloudera-scm-agent/process/ccdeploy_spark-conf_etcsparkconf.cloudera.spark_on_yarn_-3339932774132431897/spark-conf ']'
+ pushd /run/cloudera-scm-agent/process/ccdeploy_spark-conf_etcsparkconf.cloudera.spark_on_yarn_-3339932774132431897/spark-conf
+ /run/cloudera-scm-agent/process/ccdeploy_spark-conf_etcsparkconf.cloudera.spark_on_yarn_-3339932774132431897/scripts/control.sh client
/usr/lib/cmf/service/client/deploy-cc.sh: line 193: /run/cloudera-scm-agent/process/ccdeploy_spark-conf_etcsparkconf.cloudera.spark_on_yarn_-3339932774132431897/scripts/control.sh: Permission denied My sudoers file seems accurate: #
# This file MUST be edited with the 'visudo' command as root.
#
# Please consider adding local content in /etc/sudoers.d/ instead of
# directly modifying this file.
#
# See the man page for details on how to write a sudoers file.
#
Defaults env_reset
Defaults mail_badpass
Defaults secure_path="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin"
# Host alias specification
# User alias specification
# Cmnd alias specification
# User privilege specification
root ALL=(ALL:ALL) ALL
# Members of the admin group may gain root privileges
%admin ALL=(ALL) ALL
# Allow members of group sudo to execute any command
%sudo ALL=(ALL:ALL) NOPASSWD:ALL
# See sudoers(5) for more information on "#include" directives:
#includedir /etc/sudoers.d
cloudera-scm ALL=(ALL) NOPASSWD:ALL
%cloudera-scm ALL=(ALL) NOPASSWD: ALL And my /etc/passwd should be ok: cloudera-scm:x:112:119:Cloudera Manager,,,:/var/lib/cloudera-scm-server:/bin/nologin And: # id cloudera-scm
uid=112(cloudera-scm) gid=119(cloudera-scm) groups=119(cloudera-scm),27(sudo) Does anyone know what is going on? Thanks in advance!
... View more
Labels:
06-21-2017
09:14 AM
The python command should be all one line, or use a "\" to continue on a new line. For example: $ python -c "import socket; print socket.getfqdn(); print socket.gethostbyname(socket.getfqdn())" or $ python -c "import socket; print socket.getfqdn(); \ print socket.gethostbyname(socket.getfqdn())"
... View more