Reply
Explorer
Posts: 6
Registered: ‎05-29-2015
Accepted Solution

Cloudera Manager cannot find KUDU parcel

I tried to install KUDU using parcel as described in the documentation here http://www.cloudera.com/content/cloudera/en/downloads/betas/kudu/0-5-0.html

 

After copying the csd file and cloudera-scm-manager restart, I don't find KUDU parcel in Cloudera Manager: Hosts > Parcels

 

I see the following error in the cloudera-scm-server.log. 

2015-09-28 14:07:23,942 WARN main:com.cloudera.csd.components.CsdLocalRepository: Skipping [/opt/cloudera/csd/KUDU-0.5.0.jar]: { Could not read service descriptor for csd [KUDU-0.5.0]: Can not construct instance of com.cloudera.csd.descriptors.CsdLoggingType from String value 'glog': value not one of declared Enum instance names
at [Source: [B@7cc80f50; line: 71, column: 28] (through reference chain: ServiceDescriptor["roles"]->RoleDescriptor["logging"]->LoggingDescriptor["loggingType"]) }

 

I am using Version: Cloudera Express 5.4.0 (#165 built by jenkins on 20150414-2034 git: af2559c49fb999c5be97d6a3ca64db14aa42fc49)

 

Thanks,

Highlighted
Cloudera Employee
Posts: 20
Registered: ‎09-28-2015

Re: Cloudera Manager cannot find KUDU parcel

Hi SableFour,

 

Cloudera Manager version 5.4.3 is required for installing Kudu, but 5.4.7 is recommended in order to get access to all features (notably metrics). Could you update to 5.4.7 and try again? We will update our documentation soon to call this out more clearly. Thanks for the report!

Explorer
Posts: 6
Registered: ‎05-29-2015

Re: Cloudera Manager cannot find KUDU parcel

Thanks

 

After upgrading cloudera manager to 5.4.7, KUDU parcel is available in Hosts > Parcels in Cloudera Manager.

 

Followed this documentation to upgrade Cloudera Manager http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_ag_upgrade_cm5.html

 

New Contributor
Posts: 4
Registered: ‎04-27-2016

Re: Cloudera Manager cannot find KUDU parcel

I am using QuickStart VM version CDH 5.5 and would like to install Kudu on it.

 

I follow the steps in this link http://www.cloudera.com/documentation/betas/kudu/0-5-0/topics/kudu_installation.html

After restart the cloudera manager server, I can't find the KUDU parcel in the cloudera manager. 

 

To make sure I am using the right version of CSD file, I downloaded the version 0.8.0 from this link

http://archive.cloudera.com/beta/kudu/csd/

But, the parcel is still not found. 

 

Any advice?

 

Thank you.

 

 

Cloudera Employee
Posts: 47
Registered: ‎02-05-2016

Re: Cloudera Manager cannot find KUDU parcel

Have you tried the Kudu QuickStart VM? It's like the CDH VM but it comes with Kudu and Impala preloaded, so you needn't worry about installing Kudu in it.

 

In any case, one thing that may help is if you follow the latest documentation: http://www.cloudera.com/documentation/betas/kudu/latest/topics/kudu_installation.html. It's like the link you provided, but instead of "0-5-0" it's "latest".

 

Installing the Kudu CSD should instruct Cloudera Manager on the location of the Kudu parcel. Some things to check:

  • In the CM server log (/var/log/cloudera-scm-server/cloudera-scm-server.log), are there are any references to the KUDU CSD? Search the log for "KUDU" (in upper-case letters).
  • If you try to add a new service in CM, does Kudu appear as one of the options?
  • Where exactly on the CM server machine did you place the CSD file you downloaded?
New Contributor
Posts: 4
Registered: ‎04-27-2016

Re: Cloudera Manager cannot find KUDU parcel

Hi Adar, 

Thanks for the latest link provided. I am using the version 0.8.0 as stated in the link. I followed the instruction, copy the jar file to the location /opt/cloudera/csd/ and then restart the cloudera manager with command 

sudo service cloudera-scm-server restart
  •  Search the log file (/var/log/cloudera-scm-server/cloudera-scm-server.log) for keyword "KUDU". 

 

 

2016-04-27 17:07:23,432 INFO main:com.cloudera.csd.components.CsdRegistryImpl: Installed 1 handlers for CSD [KUDU-0.8.0]
2016-04-27 17:07:23,436 INFO main:com.cloudera.parcel.components.ParcelManagerImpl: Adding remote parcel repository : http://archive.cloudera.com/beta/kudu/parcels/latest/
2016-04-27 17:07:23,460 INFO main:com.cloudera.enterprise.Translator: Translations for bundle [ACCUMULO] and locale [de] are missing.
2016-04-27 17:07:23,461 INFO main:com.cloudera.enterprise.Translator: Translations for bundle [ACCUMULO] and locale [es] are missing.
2016-04-27 17:07:23,461 INFO main:com.cloudera.enterprise.Translator: Translations for bundle [ACCUMULO] and locale [fr] are missing.
2016-04-27 17:07:23,461 INFO main:com.cloudera.enterprise.Translator: Translations for bundle [ACCUMULO] and locale [pt_PT] are missing.
2016-04-27 17:07:23,461 INFO main:com.cloudera.enterprise.Translator: Translations for bundle [ACCUMULO] and locale [pt_BR] are missing.
2016-04-27 17:07:23,462 INFO main:com.cloudera.enterprise.Translator: Translations for bundle [ACCUMULO] and locale [ja] are missing.
2016-04-27 17:07:23,462 INFO main:com.cloudera.enterprise.Translator: Translations for bundle [ACCUMULO] and locale [ko] are missing.
2016-04-27 17:07:23,462 INFO main:com.cloudera.enterprise.Translator: Translations for bundle [ACCUMULO] and locale [zh_CN] are missing.

 

Also found this:

2016-04-27 17:08:04,186 INFO MainThread:com.cloudera.cmon.components.MetricSchemaManager: Registering CSD metrics...
2016-04-27 17:08:04,207 INFO MainThread:com.cloudera.cmon.components.CsdMetricSchemaGenerator: Loading monitoring definitions from HUE-5.5.0
2016-04-27 17:08:04,208 INFO MainThread:com.cloudera.cmon.components.CsdMetricSchemaGenerator: Loading monitoring definitions from KUDU-0.8.0
2016-04-27 17:08:04,208 INFO MainThread:com.cloudera.cmon.components.CsdMetricSchemaGenerator: Loading monitoring definitions from HIVE-5.5.0
2016-04-27 17:08:04,208 INFO MainThread:com.cloudera.cmon.components.CsdMetricSchemaGenerator: Loading monitoring definitions from KAFKA-5.5.0
2016-04-27 17:08:04,208 INFO MainThread:com.cloudera.cmon.components.CsdMetricSchemaGenerator: Loading monitoring definitions from /mgmt.mdl
2016-04-27 17:08:04,208 INFO MainThread:com.cloudera.cmon.components.CsdMetricSchemaGenerator: Loading monitoring definitions from /mdls/cdh5/oozie.mdl

 

And this: 

2016-04-27 17:07:23,278 INFO main:org.mortbay.log: Registered SubjectType KUDU
2016-04-27 17:07:23,278 INFO main:com.cloudera.cmon.TimeSeriesEntityType: Registered TimeSeriesEntityType KUDU
2016-04-27 17:07:23,278 INFO main:org.mortbay.log: Registered SubjectType KUDU-KUDU_MASTER
2016-04-27 17:07:23,279 INFO main:com.cloudera.cmon.TimeSeriesEntityType: Registered TimeSeriesEntityType KUDU-KUDU_MASTER
2016-04-27 17:07:23,279 INFO main:org.mortbay.log: Registered SubjectType KUDU-KUDU_TSERVER
2016-04-27 17:07:23,279 INFO main:com.cloudera.cmon.TimeSeriesEntityType: Registered TimeSeriesEntityType KUDU-KUDU_TSERVER

 

  • If you try to add a new service in CM, does Kudu appear as one of the options? 
    Yes. But with warning in red font, Kudu is currently in Beta and is not supported. Before adding this service, ensure that you have installed the Kudu binaries, which are not included in CDH.
  •  Where exactly on the CM server machine did you place the CSD file you downloaded?
    I am running an QuickStart VM. It is single node. 

 

Meanwhile, I will try the Kudu QuickStart VM. 

 

Thank you.

 

 

 

 

Cloudera Employee
Posts: 47
Registered: ‎02-05-2016

Re: Cloudera Manager cannot find KUDU parcel

Interesting. Your log output shows that the CM server is loading the Kudu CSD correctly. It even shows that it's adding the parcel repository for Kudu ("Adding remote parcel repository : http://archive.cloudera.com/beta/kudu/parcels/latest/").

 

And yet, when you navigate to Host->Parcels, you don't see any KUDU parcels listed? Is a browser on that machine able to access the parcel repository URL (http://archive.cloudera.com/beta/kudu/parcels/latest)?

 

New Contributor
Posts: 4
Registered: ‎04-27-2016

Re: Cloudera Manager cannot find KUDU parcel

Hi Adar,

Yes. I don't see any parcel listed in the cloudera manager web portal. (Host->Parcels). And the QuickStart VM has internet access to the parcel repository (http://archive.cloudera.com/beta/kudu/parcels/latest).

 

Thank you.

Cloudera Employee
Posts: 47
Registered: ‎02-05-2016

Re: Cloudera Manager cannot find KUDU parcel

That's very strange. Could you verify in the CM server settings (Administration->Settings) that "Remote Parcel Repository URLs" includes an entry for http://archive.cloudera.com/beta/kudu/parcels/latest? Could you also verify that other Cloudera parcels are listed in Host->Parcels, and that the list of parcels isn't completely empty?

New Contributor
Posts: 4
Registered: ‎04-27-2016

Re: Cloudera Manager cannot find KUDU parcel

[ Edited ]

 

It was because of the firewall and DNS settings in our office network. It clears the doubts and I can see the parcels now. Thank you for your support.