About geralt

geralt · ‎12-15-2020

Do you know if it is possible to configure Cloudera Manager to connect to a postgres cluster instead of a single database ? We have an external postgresql database for cloudera manager and CDH services like hive, hue and oozie, but we want to achieve High Availability for this database, so we thought that we could implement a cluster and manage it with repmgr and pgpool. But before starting we would like to know if we can easily implement this solution with cloudera. Thanks.

geralt · ‎09-09-2020

Ok thanks @GangWar. So this is going to migrate only CM configuration from PostgreSQL to Oracle, right ? But what about other data like for example details about Oozie workflows and schedules ? They're stored inside the PostgreSQL database, how we're supposed to move this data to Oracle ?

geralt · ‎09-08-2020

Thanks. As I said we already tested the migration from the embedded database to an external PostgreSQL without any issue. The problem is that it's not clear how we should backup and migrate data from the external PostgreSQL to Oracle. In the link you posted there is no indication about how to migrate the database (https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_ag_migrate_postgres_db_to_oracle_mysql.html). Maybe I'm missing something... Here are the steps Step 6: prepare the target database for Cloudera Manager. For details, refer to Install and Configure MySQL for Cloudera Software or Install and Configure Oracle Database for Cloudera Software. So, we went to Install and Configure Oracle Database for Cloudera Software and we configured our Oracle Database in order to host Cloudera Manager and other CDH services. Obviously there is no info about how to migrate data between databases since this guide is for a clean cluster setup. Back to the guide you posted: step 7: is about stopping cloudera manager agents step 8-13: they talk about restoring the cloudera manager configuration, there's not any suggestion about how to migrate data between an external postgresql database and a oracle database. could you kindly enlighten me about this aspect? because from the way you indicated it seems to be right under my nose but I can't see it.

geralt · ‎09-01-2020

Hello, we would like to move our environment from the embedded PostgreSQL database to an ad-hoc Oracle database. We experimented a in a toy cluster moving from the embedded Postgres to an external one and it was quite easy following the documentation (for reference: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_ag_migrate_postgres_db.html). The problem is moving from a db to another. The documentation is still pretty good and it explains everything about how to configure the Oracle instance in order to correctly work with Cloudera, but there is no clear indication on how to move data from Postgres to Oracle. We know that there are instruments capable of migrating data between Postgres and Oracle, but we would like to know if there are best practices from Cloudera in order to do so. Thanks

geralt · ‎05-18-2020

I'll answer myself since I found out what the problem was. Since I "inherited" this cluster I am not aware of all the things that have been done on it. I've found out that on the node that hosts the Cloudera Manager and some of the other the JCE was manually installed. So what I did was to manually install JCE on the other nodes that were missing the library (it's a very simple procedure, you just have to copy two jars in the java home). Then the Kerberos installation was smooth sailing like the other times I did it. I think that maybe the CM should have a way to indicate a situation like this and not hang forever leaving the user completely unaware of what is happening. In my case I was lucky that I could ssh into the nodes and investigate about the issue.

geralt · ‎05-05-2020

Hello everybody, the title explains pretty much the annoying issue I'm facing. I have to install the JCE policy files, but when I click on the button there is no actual response from Cloudera Manager. It keeps loading the wizard page but it doesn't go on. I know I should be redirected on the wizard page. I tried to restart the cm-server process, the cms, the cm-agent with no result. Also I can't find anything inside the cm-server and cm-agent logs. I'm using Cloudera Express 6.3.0. I faced this problem another time in the past, but in that case it magically autosolved: I was tired of this annoying issue and I started doing some other work and left the tab open. At a certain point it loaded the wizard page. But this time I can't wait too much since I have some deadlines to deal with and honestly more than three hours have passed now. Any help would be appreciated, thanks.

geralt · ‎04-06-2020

Hello, I was asked if it was possible to configure Cloudera Manager, Navigator and Hue (CDH 6.3.0) to handle external authentication by connecting to Oracle Access Management (OAM), which makes use of the SAML protocol. By reading the documentation I found this note SAML authentication has been tested with specific configurations of SiteMinder and Shibboleth. While SAML is a standard, there is a great deal of variability in configuration between different IDP products, so it is possible that other IDP implementations, or other configurations of SiteMinder and Shibboleth, may not interoperate with Cloudera Manager. So I was wondering if anyone here has ever worked with Cloduera and OAM, and if is it feasible to implement external authentication. Thanks in advance

geralt · ‎01-09-2020

Hello and happy new year! I'm sorry for the delay of my response, but I somehow managed to solve the issue. The fact was that I was trying to import the cluster template on a cluster that was already "initialized". What I think it happened is that during my tests with the cluster template I wrote a malformed json file (which brought to some errors during the installation) but the cluster template install command still managed to create an empty cluster. When I tried again the procedure with the correct cluster template json I didn't think about deleting the cluster and this caused the issue I presented in the post. When I deleted from scratch everything and tried again the procedure it worked. By the way I followed this documentation https://docs.cloudera.com/documentation/enterprise/latest/topics/install_cluster_template.html

geralt · ‎12-16-2019

Hello everybody, first post here so pardon me if I didn't follow all the rules. So, I'm trying to deploy a cluster (on a single host) using Ansible and Cloudera's APIs. I have managed to install Cloudera Manager and Cloudera Management Service correctly. Now I'd like to install CDH services on this node, but I have some problems with the errors that the API returns to me. In particular I'm trying to install the services by the means of a clusterTemplate. I've managed to download a cluster template from another cluster I've deployed in the past and I'd like to use this to create a new cluster on this node. Actually I would prefer to create a cluster template from scratch but I was not able to find any useful information to build one. By the way the problem is, when I call the apis the message I receive in response is "message" : "The following host(s) are not available: <fully qualified hostname of my node>. If necessary I'll provide the python code I'm using for calling the apis, but I just copied the code I found on the API's doucmentation. Plus, even if I use a curl to contact the apis I receive the same error. Also, I'm using a EC2 aws instance for deploying the cluster. Thanks in advance for your help.

Online	Offline
Last Visited	‎02-10-2021 12:31 PM

Date Registered	‎12-16-2019 03:35 AM
Last Visited	‎02-10-2021 12:31 PM
Total Messages Posted	10

Re: Cloudera Manager hangs when installing JCE

Cloudera Manager with Postgresql cluster

Re: Migration from embedded PostgreSQL to Oracle D...

Re: Migration from embedded PostgreSQL to Oracle D...

Migration from embedded PostgreSQL to Oracle DB

Re: Cloudera Manager hangs when installing JCE

Cloudera Manager hangs when installing JCE

Configure external authentication with Oracle Acce...

Re: Issue with API v33 and Python client

Issue with API v33 and Python client