@vaishaakb sorry, I forgot to tag you ... View more

I am curious how Cloudera managed to get hold of a Centos 8.6 version out of the blue when apparently Centos final release was as per https://en.wikipedia.org/wiki/CentOS Final release 8.5.2111[2]   (16 November 2021 ; 14 months ago )   ... View more

Hi Vaishakkb.   Thank you again for your response.    Unfortunately I am unable to make it work. Looking at the docs (https://archive.cloudera.com/cm6/6.3.0/generic/jar/cm_api/apidocs/resource_RoleConfigGroupsResource.html#resource_RoleConfigGroupsResource_ClustersResourceV33_ServicesResourceV33_RoleConfigGroupsResource_updateConfig_PUT) for that endpoint, it seems to want an ApiConfigList rather than an ApiRoleList. If I try to use an ApiRoleList object I get "message" : "Unrecognized property: for anything I put in it after "items".   Cheers   --  Pete   ... View more

@prabhu111, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.   ... View more

Hello @vaishaakb ,   Sadly we did not reach the solution for the main issue yet.   Yes, I checked this blog and I also checked every documentation provided by cloudera or others to try resolving this issue but no luck.   Also I want to point out that the blog's first demo is not working properly and the cloudera team posted something that shows an error ImportError: No module named numpy  Which proves that the docker image didn't work with pyspark properly. ... View more

Hello @vtpcnk Good Day!   Circling back to see if my post helped you with this task. If yes, Please mark the answer as "Accept as Solution". So this will be highlighted as solution to this ask for other users in our community.   V ... View more

Hey @hanumanth Thank you for marking this post as Accepted Solution. If you find my sanity checks helpful, you can also thank me by clicking on the thumbs up button:)   V ... View more

Hello @TalhaKilic  Did my response help you with the request made? If yes, Please mark my reply as 'Accept As Solution' of if you still need further help, Please update this thread.    V ... View more

@poorva, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.  ... View more

That was same my file. I changed '/var/lib/cloudera-scm-agent/uuid' file was not [noeol] file, so I changed that file. And can i show your error log in /var/run/cloudera-scm-agnet/process-*-HUE_SERVER Thank you ... View more

Hi @bsaad  Thank you for helping me with the logs, Sounds like a "Hardening" issue, if that is what to be mentioned by VirtualBox Community.   Please read these and triage the situation based on your System Specs: VirtualBox Threads:  https://forums.virtualbox.org/viewtopic.php?f=6&t=95559 Diagnosing VirtualBox Hardening Issues   Hope this helps! Is your question answered? If Yes, Feel free to mark the answer as "Accept as Solution". If you find this reply helpful, say thanks by clicking on the "thumbs-up" button. ... View more

Hi @vaishaakb  Thank you for the reply.  I understand that dropping table / database in the cluster doesn't replicate it back to the cloud back-up.  We have a usecase where each month our internal customers create some tables / databases, work on them for few days and then drop them once they are done. As a result of this, S3 bucket has many abandoned databases which is growing day-by-day.  It would be really helpful if you could advise a way to keep the S3 bucket in-sync with the Hive.   Thank you, Snehasish ... View more

Hi @Nick Error found before invoking supervisord: [Errno 2] No such file or directory: '/sys/fs/cgroup/cpuacct,cpu/system.slice/docker-542551d4e6b6ca6c6ab65a6f3b51c538b126a1762b36b35b7ba9023ed262f953.scope/185-yarn-RESOURCEMANAGER' The above looks like you have this inside a Docker container. Please confirm. - Could you do the following to help us understand this better 1. Have you tried running the docker as the privileged mode? if you do not have mounts configured? #docker run -t -i --privileged os-flavor:os-version (example centos:6) 2. Create directory using root where the CM is trying to create the specified path: #mkdir /sys/fs/cgroup/cpuacct,cpu/systemd/system.slice/ Let me know how it goes. Thanks V ... View more

Hello @kotni,    The Stack trace says the connection is refused on the NameNode port(9870) dfs.namenode.http-address , hence make sure the required ports are configured/opened in both the source and Destination clusters on performing Distcp.   - Here is the list of ports used by CDH components and DistCP - https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cdh_ports.html - https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/install_ports_distcp.html   Post that, Try out the below: - Examples of DistCP syntaxes to try out https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cdh_admin_distcp_data_cluster_migrate.html#distcp_examples   Let us know how it goes. - Vaishaak   ... View more

Hello  TheRabroub,   Thank you for posting this in our Community.   E: Failed to fetch  https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/pool/contrib/o/oracle-j2sdk1.7/oracle-j2sdk1...  transfer closed with 118225812 bytes remaining to read   "The above could mean that the connectivity between the Host and the Cloudera archive might have been intervened by network congestion/flaky network"   E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing? END (100) remote package oracle-j2sdk1.7   Have you tried the above-mentioned? If not,  Since you are on Ubuntu, Try to fix/retry the missing packages by executing this:   #sudo apt-get update or #sudo apt-get update --fix-missing   Let us know how it goes.   Cheers ... View more