About Chetankumar

Chetankumar · ‎09-16-2021

Thanks @ShounenG . Want to ask how I was able to install spark2 from services when I don't have csd only parcels. Now I deleted the spark2 service and installed the csd and activated parcels again. But now I can't see the spark2 service to install. Is this that spark2 service deletion wasn't done properly?

Chetankumar · ‎09-16-2021

Also The spark2 service was added earlier using parcel only as I haven't copied the csd file earlier. I deleted the service rom cloudera manager and now I can't see the service. Do we need to perform some more cleanup of service even if we delete from CM?

Chetankumar · ‎09-16-2021

HI, Thanks for your reply. I have checked the logs and found this warning. WARN main:com.cloudera.csd.components.CsdLocalRepository: Skipping [/opt/cloudera/csd/SPARK2_ON_YARN-2.3.0.cloudera4.jar]: { Could not read service descriptor for csd [SPARK2_ON_YARN-2.3.0.cloudera4]: Could not resolve type id 'provided' into a subtype of [simple type, class com.cloudera.csd.descriptors.parameters.Parameter<java.lang.Object>]

Chetankumar · ‎09-16-2021

I am using cloudera 5.10 and trying to install spark 2.3. I have csd and activated spark2 parcel. Also did a restart of cloudera server and cloudera manager service. Still can't see the spark2 service. Before that I Deleted the service from Cloudera manager and trying to reinstall and found the spark2 service is missing. Could you please tell me what is wrong?

Chetankumar · ‎08-30-2021

I am trying to install spark2 cdh5.13.3 on CDH 5.10 and have 3 files .parcel , .parcel.torrent and .parcel.sha . I have added the repository web url in the cloudera parcel configuration and not able to find the parcel in the cloudera manager? Could you please let me know what is missing here ?

Chetankumar · ‎04-21-2021

Hi, This is Cloudera Express 5.10.0

Chetankumar · ‎04-21-2021

Hi, I am currently using Cloudera version 5.10 in my Production environment. Since 1st of February 2021 all the task including upgrade, add/remove services and other operations require a username and password. Although Cloudera express is still free version until 6.3.2. Since I have the downloaded binaries can I use them to perform the upgrade? https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ag_licenses.html https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_6_download.html

Chetankumar · ‎04-20-2021

Hi @kingpin Thanks for your reply. Yes this solution worked and now we are able to remove the old disk and after rebalance new disks are in use. We will continue to remove the disk from each node after the rebalance complete after each attempt.

Chetankumar · ‎04-19-2021

Hi, I want to remove some old disk and added new disk with new mount points. Now the new disk are part of CDH. Now I want to transfer the blocks from old disk /data01 to new disk /data05 and then remove /data01 after move of all blocks. Is there a way to do this ? can I take datanode services down and then manually copy? will Cloudera able to find the new blocks on /data05 (new disk) ?

Chetankumar · ‎04-16-2021

can someone let me know if there is a possibility to have the blocks on the same disk with RF=3 with 3 datanode?

Online	Offline
Last Visited	‎04-29-2024 04:45 AM

Member Since	‎04-15-2021 03:42 AM
Last Visited	‎04-29-2024 04:45 AM
Posts	23

Cloudera Community

Re: How to move block from one mount point to othe...

Re: Spark2 service not found in cloudera manager

Re: Spark2 service not found in cloudera manager

Re: Spark2 service not found in cloudera manager

Spark2 service not found in cloudera manager

Unable to find parcel using local repository

Re: Upgrade Cloudera express from 5.16 to 6.3.2

Upgrade Cloudera express from 5.16 to 6.3.2

Re: How to move block from one mount point to othe...

How to move block from one mount point to other an...

Re: Remove disk permanently from all Data Nodes