Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Cloudera Manager

Cloudera Manager

New Contributor

I am trying to install Cloudera Manager using Atlas director and I am running into some issues trying to use External AWS Postgresql RDS instance. During the bootstap process it creates these roles and then complains that the master account doenst have access to these roles. 

 

 

2019-03-08 20:02:36 UTC:10.160.43.183(55496):xxxx@postgres:[1456]:ERROR: must be member of role "wlcliysq"
2019-03-08 20:02:36 UTC:10.160.43.183(55496):xxx@postgres:[1456]:STATEMENT: create database scm_v92slbj8eks9h5i63ktbvb3dkc owner wlcliysq encoding 'UTF8'
2019-03-08 20:02:47 UTC:10.160.43.183(55498):xxx@postgres:[1604]:ERROR: must be member of role "lvmupyih"
2019-03-08 20:02:47 UTC:10.160.43.183(55498):xx@postgres:[1604]:STATEMENT: create database scm_oausqfkms67s9ekhce08b703hq owner lvmupyih encoding 'UTF8'
2019-03-08 20:02:58 UTC:10.160.43.183(55500):xxx@postgres:[1735]:ERROR: must be member of role "exeqtngg"
2019-03-08 20:02:58 UTC:10.160.43.183(55500):xxxxx@postgres:[1735]:STATEMENT: create database scm_43j037sl70k3a6jdufisk0nv9h owner exeqtngg encoding 'UTF8'
2019-03-08 20:03:19 UTC:10.160.43.183(55502):xx@postgres:[2138]:ERROR: must be member of role "unehrslm"
ding 'UTF8'
----------------------- END OF LOG ----------------------

 

As a test I tried to use Mysql RDS and that appeared to work without any issues so I am wondering if Postgresql RDS is supported?

4 REPLIES 4

Re: Cloudera Manager

Expert Contributor
Unfortunately no, PostgreSQL RDS is not supported. Sorry about that!

Re: Cloudera Manager

New Contributor

i'm running into a similar issue was the original poster except for a postgresql instance on gcp's cloudsql when attempting to to instal cloudera manger with altus director. is gcp's postgresql on cloudsql supported? is it known to be incompatible? thanks!

 

org.postgresql.util.PSQLException: ERROR: must be member of role "scmu_lphqtnvf"
at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2477)[postgresql-42.1.4.jre7.jar:42.1.4.jre7]
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2190)[postgresql-42.1.4.jre7.jar:42.1.4.jre7]
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:300)[postgresql-42.1.4.jre7.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:428)[postgresql-42.1.4.jre7.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:354)[postgresql-42.1.4.jre7.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:301)[postgresql-42.1.4.jre7.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:287)[postgresql-42.1.4.jre7.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:264)[postgresql-42.1.4.jre7.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:260)[postgresql-42.1.4.jre7.jar:42.1.4.jre7]
at com.cloudera.enterprise.dbutil.DbProvisioner.executeSql(DbProvisioner.java:299)[db-common-5.15.1.jar:]
at com.cloudera.enterprise.dbutil.DbProvisioner.doMain(DbProvisioner.java:104)[db-common-5.15.1.jar:]
at com.cloudera.enterprise.dbutil.DbProvisioner.main(DbProvisioner.java:123)[db-common-5.15.1.jar:]

 

Re: Cloudera Manager

Expert Contributor

cgiardina,

 

Altus Director is not able to manage (i.e., create/delete) cloudsql postgres databases due to a permissions issue. As you can see by the error messages, the created users are not being granted the correct role to operate on the created database.

 

You can still use postgres databases that you create and manage yourself. See the documentation and reference conf file for information on External Databases, not External Database Templates.

https://www.cloudera.com/documentation/director/latest/topics/director_external_db_using.html

https://github.com/cloudera/director-scripts/blob/master/configs/aws.reference.conf#L629-L653

https://github.com/cloudera/director-scripts/blob/master/configs/aws.reference.conf#L993-L1034

 

Re: Cloudera Manager

Expert Contributor

followup with a little more context and clarification.

 

I mis-spoke when I said that "the created users are not being granted the correct role to operate on the created database." In actuality, the role provided to Altus Director is not able to create a database with an owner other than itself. The database provisioning logic attempts to create a separate role and use that as the owner for each database. SUPERUSER privileges are required to create a database with a different owner. Google cloud sql does not support giving SUPERUSER privileges (see https://cloud.google.com/sql/docs/postgres/features under "Unsupported Features").

 

External Database Templates should work correctly if you create your own Postgres server and provide Altus Director with a SUPERUSER role.

Don't have an account?
Coming from Hortonworks? Activate your account here