Member since
04-23-2018
7
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4749 | 04-27-2018 06:08 PM |
04-27-2018
06:08 PM
I am able to resolve this problem using the following process: Step 1: Take a dump of the running postgres database on Ubuntu 14.02 # sudo su # su - postgres # pg_dump -h localhost -p 7432 -U scm scm > scm.sql Step 2: Upgrade Ubuntu to 16.04 # sudo do-release-upgrade Step 3: Rename the old data directory # mv /var/lib/cloudera-scm-server-db/data/ /var/lib/cloudera-scm-server-db/data9-3 Step 4: Restart cloudera-scm-server-db service. This will create an empty database which we will populate using the backup taken in step 1 # sudo service cloudera-scm-server-db restart Step 5: Now restore the database # sudo su # su - postgres # psql -h localhost -p 7432 -U scm (password can be obtained like this: grep password /etc/cloudera-scm-server/db.properties) scm> \i scm.sql Step 6: Now restart cloudera-scm-server service: # sudo service cloudera-scm-service restart However, I'm now running into another problem. the cloudera-scm-agent services do not start. There is an error in supervisord.out. I will open another thread for this: Traceback (most recent call last): File "/usr/lib/cmf/agent/build/env/bin/supervisord", line 8, in <module> from pkg_resources import load_entry_point File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/pkg_resources/__init__.py", line 36, in <module> import plistlib File "/usr/lib/python2.7/plistlib.py", line 62, in <module> import datetime ImportError: No module named datetime
... View more
04-24-2018
02:33 PM
I also tried to keep postgres at 9.3 while upgrading ubuntu from 14.04 to 16.04 using: However this doesn't work either. After upgrade I get this error: sudo service cloudera-scm-server-db status ● cloudera-scm-server-db.service - LSB: Cloudera SCM Server's Embedded DB Loaded: loaded (/etc/init.d/cloudera-scm-server-db; bad; vendor preset: enabled) Active: active (exited) since Tue 2018-04-24 21:08:39 UTC; 16min ago Docs: man:systemd-sysv-generator(8) Process: 2028 ExecStop=/etc/init.d/cloudera-scm-server-db stop (code=exited, status=0/SUCCESS) Process: 2078 ExecStart=/etc/init.d/cloudera-scm-server-db start (code=exited, status=0/SUCCESS) Apr 24 21:08:39 ip-172-30-1-250 runuser[2092]: pam_unix(runuser:session): session opened for user cloudera-scm by (uid=0) Apr 24 21:08:39 ip-172-30-1-250 runuser[2092]: pam_unix(runuser:session): session closed for user cloudera-scm Apr 24 21:08:39 ip-172-30-1-250 runuser[2109]: pam_unix(runuser:session): session opened for user cloudera-scm by (uid=0) Apr 24 21:08:39 ip-172-30-1-250 cloudera-scm-server-db[2078]: bash: /usr/lib/postgresql/9.5/bin/pg_ctl: No such file or directory Apr 24 21:08:39 ip-172-30-1-250 runuser[2109]: pam_unix(runuser:session): session closed for user cloudera-scm Apr 24 21:08:39 ip-172-30-1-250 runuser[2111]: pam_unix(runuser:session): session opened for user cloudera-scm by (uid=0) Apr 24 21:08:39 ip-172-30-1-250 cloudera-scm-server-db[2078]: bash: /usr/lib/postgresql/9.5/bin/pg_ctl: No such file or directory Apr 24 21:08:39 ip-172-30-1-250 runuser[2111]: pam_unix(runuser:session): session closed for user cloudera-scm Apr 24 21:08:39 ip-172-30-1-250 cloudera-scm-server-db[2078]: * Failed to start Cloudera manager database Apr 24 21:08:39 ip-172-30-1-250 systemd[1]: Started LSB: Cloudera SCM Server's Embedded DB. It looks like cloudera scm server is looking for 9.5 version of postgres on ubuntu 16.04. Is this hardcoded somewhere?
... View more
04-24-2018
07:41 AM
Hello, Thanks for replying. Yes, I will upgrade CDH as well. However, I am unable to get cloudera-scm-server service running after OS upgrade. This is because the cloudera-scm-server-db service doesn't start because the postgres version gets updated from 9.3 to 9.5 during the OS upgrade step. I have tried to migrate the database but during the restore process I get this error: ERROR: role "cloudera-scm" does not exist Is there any document on how to migrate a cloudera postgres database? Thanks
... View more
04-23-2018
12:24 PM
We are currently using Cloudera Express 5.10.0 on Ubuntu 14.04.5. This cluster was installed using cloudera manager. We need to ugprade to Ubuntu 16.04 as 14.04 is approaching EOL. What is the recommended process? Do we upgrade Cloudera first and then Ubuntu or Ubuntu first and then Cloudera? I have tried to upgrade ubuntu first. But Ubuntu (do-release-upgrade) upgrades postgres from 9.3 to 9.5. Since the database formats between 9.3 and 9.5 are not compatible, the cloudera-scm-server-db doesn't start. I have tried to migrate the database using pg_dump/pg_restore etc but have failed so far. If there is a document available somewhere, please let me know.
... View more
Labels:
- Labels:
-
Cloudera Manager